-- Logs begin at Fri 2022-05-27 08:35:45 UTC, end at Fri 2022-05-27 09:59:36 UTC. -- May 27 09:13:27.148358 dv-cinder-825492-18-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 09:13:27.157023 dv-cinder-825492-18-smb devstack@keystone.service[80372]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:13:27 2022] *** May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: nodename: dv-cinder-825492-18-smb May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: machine: x86_64 May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: clock source: unix May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: pcre jit disabled May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: detected number of CPU cores: 4 May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: current working directory: / May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: detected binary path: /usr/bin/uwsgi-core May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: your processes number limit is 47680 May 27 09:13:27.159643 dv-cinder-825492-18-smb devstack@keystone.service[80372]: your memory page size is 4096 bytes May 27 09:13:27.160275 dv-cinder-825492-18-smb devstack@keystone.service[80372]: detected max file descriptor number: 2048 May 27 09:13:27.160275 dv-cinder-825492-18-smb devstack@keystone.service[80372]: lock engine: pthread robust mutexes May 27 09:13:27.160275 dv-cinder-825492-18-smb devstack@keystone.service[80372]: thunder lock: enabled May 27 09:13:27.160275 dv-cinder-825492-18-smb devstack@keystone.service[80372]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 09:13:27.160275 dv-cinder-825492-18-smb devstack@keystone.service[80372]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:13:27.206081 dv-cinder-825492-18-smb devstack@keystone.service[80372]: Python main interpreter initialized at 0x55a05b34e9c0 May 27 09:13:27.206081 dv-cinder-825492-18-smb devstack@keystone.service[80372]: python threads support enabled May 27 09:13:27.206081 dv-cinder-825492-18-smb devstack@keystone.service[80372]: your server socket listen backlog is limited to 100 connections May 27 09:13:27.206081 dv-cinder-825492-18-smb devstack@keystone.service[80372]: your mercy for graceful operations on workers is 90 seconds May 27 09:13:27.206472 dv-cinder-825492-18-smb devstack@keystone.service[80372]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:13:27.206558 dv-cinder-825492-18-smb devstack@keystone.service[80372]: *** Operational MODE: preforking *** May 27 09:13:27.206798 dv-cinder-825492-18-smb devstack@keystone.service[80372]: *** uWSGI is running in multiple interpreter mode *** May 27 09:13:27.206798 dv-cinder-825492-18-smb devstack@keystone.service[80372]: spawned uWSGI master process (pid: 80372) May 27 09:13:27.207013 dv-cinder-825492-18-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 09:13:27.208358 dv-cinder-825492-18-smb devstack@keystone.service[80372]: spawned uWSGI worker 1 (pid: 80385, cores: 1) May 27 09:13:27.208358 dv-cinder-825492-18-smb devstack@keystone.service[80372]: spawned uWSGI worker 2 (pid: 80386, cores: 1) May 27 09:13:27.208358 dv-cinder-825492-18-smb devstack@keystone.service[80372]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:13:32.887710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:13:32.887710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: from cryptography.utils import int_from_bytes May 27 09:13:32.888564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:13:32.888564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: from cryptography.utils import int_from_bytes May 27 09:13:32.896114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:13:32.896114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes May 27 09:13:32.896643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:13:32.896643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes May 27 09:13:32.943183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:13:32.943387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:13:32.943553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] command line args: [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:13:32.943825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:13:32.944003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ================================================================================ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:13:32.944258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] admin_token = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.944429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:13:32.944523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] config_dir = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.944635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:13:32.944720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.944832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] command line args: [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:13:32.944922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] config_source = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] debug = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:13:32.945257 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ================================================================================ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:13:32.945519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] config_dir = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.945988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] config_source = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] debug = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_config_append = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.946953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_dir = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_config_append = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.947987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_dir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.948973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.949949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.950844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] publish_errors = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.951969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] publish_errors = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] standard_threads = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.952924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] use_journal = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.953951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] use_json = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] use_stderr = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] standard_threads = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] use_syslog = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.954936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.955050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.955164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.955818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.955966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] use_journal = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.956107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.956229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] use_json = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.956229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] use_stderr = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.956474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.956603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] use_syslog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.956725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.956840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:13:32.956953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.957885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.958905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.959959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.960930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.961878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.962924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.963990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.964963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.965955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.966982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.967784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.968952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.969894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.970839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.971610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.971835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.971956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.972983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.973899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.974958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.975916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.976989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.977936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.978944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.979903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.980901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.external = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.981960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.password = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] auth.token = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.982926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.external = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.983985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.password = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.token = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.984927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.985953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.986952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.987903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.988915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.989967 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.990914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.991977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.992934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.993890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.994912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.995977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.996924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.997877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.998906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:32.999971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.000951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.001825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.002963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.003978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.004883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.005963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.006956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.007991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008597 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.008954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.009912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.010976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.011880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.012976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013325 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013597 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.013976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] role.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] role.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.014939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.015994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] role.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] role.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.016974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.017093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.017209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.017328 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.017445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.017563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.018938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.019888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.020952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.021911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.022967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023325 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.023915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.024911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.025978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.026924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.027998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.028843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.029980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.030932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.031987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.032957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:13:33.032957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:13:33.061463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.061702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.061787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.061905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.061990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.062222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.071115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.072201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.100950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.101172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.101717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.101953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.155409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.155640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.209401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.209660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.209871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.210042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.276912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277192 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.277998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.278081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.278215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.302483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.302651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.302747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.302815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.302929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.303893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.316026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.316198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.328600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.328834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.328977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.329963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.330099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.330866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:13:33.348127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.348368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:13:33.348525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.348712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.348804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:13:33.348921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:13:33.349060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.349192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.349272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:13:33.349456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.349536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.349717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.349797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.349976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.350055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.350255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.361390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.361703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.361974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.362258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.362813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.363090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.363361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.363646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.370436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.371827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.373758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.374042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.374324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.374604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.374886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.375141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.375226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.375424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.375526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.375707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.375796 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.375991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.376078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.376277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.376375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.376620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.376713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.376943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.377751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.378027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.378305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.378576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.404055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.405628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.405830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.406115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.407353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.407636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.411415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.411696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.411980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.413069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.413351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.413636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.419309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.419594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.421342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.421628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.424383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.424788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.425076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.425363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.425643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.425928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.426203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.426283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.426475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.426605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.426894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.427190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.427479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.427759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.428052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.428356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.445678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.445963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.447582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.447866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.450701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.452609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.454373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.454668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.456856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.457154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.460297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.462195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.463921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.465848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.467726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.468025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.468337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.468629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.468918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.469215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.469635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.469942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.470237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.470523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.470809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.471128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.488226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.488537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.488806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.489069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.490176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.490464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.490732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.490996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.497090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.498817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.499047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.499135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.500798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.501076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.502675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.502960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.503241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.503532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.503810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.504696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.504983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.505266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.505549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.505827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.517348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.517632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.518480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.518762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.519043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.519320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.519603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.519998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.520291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.520600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.520891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.521175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.521451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.521737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.537693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.539788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.543398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.543645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.544305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.546198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.546686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.547841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.548128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.548304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.548445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.549975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.550272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.550574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.555870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.557527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.557984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.559603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.560882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.561181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.561470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.561750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.563578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.563870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.564157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.564472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.571420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.571707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.572095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.574133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.574421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.574807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.579998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.580874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.581128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.581424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.581700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.581977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.582269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.582537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.582813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.583081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.583265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:13:33.583408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.583548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.583631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.583826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.583908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.584099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.584190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.584391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.584666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.584940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.585233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.585505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.585781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.586053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.586316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.586581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.586864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:13:33.622927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a05b34e9c0 pid: 80386 (default app) May 27 09:13:33.625546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a05b34e9c0 pid: 80385 (default app) May 27 09:13:33.626246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2b4af-bd4e-4a24-9d9a-adeafd8557c8 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:33.626541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2b4af-bd4e-4a24-9d9a-adeafd8557c8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:33.626820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2b4af-bd4e-4a24-9d9a-adeafd8557c8 None None] PATH_INFO: `/v3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:33.631649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Fri May 27 09:13:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:42.770639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13032e54-834e-448f-8570-363870627eb6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:42.771174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13032e54-834e-448f-8570-363870627eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:42.771174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13032e54-834e-448f-8570-363870627eb6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:42.775600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:42.780767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:42.781136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:42.781324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:42.850605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: INFO dbcounter [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] Registered counter for database keystone May 27 09:13:42.871746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG oslo_db.sqlalchemy.engines [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:13:42.878142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writer thread running {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:13:43.059302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG passlib.handlers.bcrypt [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 09:13:43.059588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG passlib.handlers.bcrypt [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 09:13:43.118281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:43.119936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:43.254470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 09:13:43.305789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13032e54-834e-448f-8570-363870627eb6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:43.376499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: INFO dbcounter [None req-13032e54-834e-448f-8570-363870627eb6 None None] Registered counter for database keystone May 27 09:13:43.396542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG oslo_db.sqlalchemy.engines [None req-13032e54-834e-448f-8570-363870627eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:13:43.403196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writer thread running {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:13:43.521998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13032e54-834e-448f-8570-363870627eb6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:43.526325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:43.526995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:43.527282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:43.527565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:43.536620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:43.587457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 09:13:43.587805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80393e99-1fc7-413b-9513-4c8ba376a49b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:43.598706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Fri May 27 09:13:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:13:43.604830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:43.619276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9e9c-6382-47ff-9efb-757e2cb1d1df None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:43.623679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:43.624834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:43.625122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:43.625401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] PATH_INFO: `/v3/projects/41e0cce5349a484a984be8bf5c634f8a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:43.626945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=41e0cce5349a484a984be8bf5c634f8a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:43.786032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 09:13:43.786663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453cae5-5f51-46db-af2c-a8de9d5a2aa1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:43.791029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Fri May 27 09:13:43 2022] GET /identity/v3/projects/41e0cce5349a484a984be8bf5c634f8a => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:45.985291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d77a-4f25-49ae-b987-b940ebaf3d38 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:45.985811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d77a-4f25-49ae-b987-b940ebaf3d38 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:45.985897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d77a-4f25-49ae-b987-b940ebaf3d38 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:45.990493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:45.996122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:45.996559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:45.996725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:46.015880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:46.017423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:46.025221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 09:13:46.047900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d77a-4f25-49ae-b987-b940ebaf3d38 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:46.060608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d77a-4f25-49ae-b987-b940ebaf3d38 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:46.064837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76967d-06bb-49ce-ae43-f4846e60b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:46.065534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76967d-06bb-49ce-ae43-f4846e60b5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:46.065824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76967d-06bb-49ce-ae43-f4846e60b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:46.066146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76967d-06bb-49ce-ae43-f4846e60b5d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:46.074228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76967d-06bb-49ce-ae43-f4846e60b5d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:46.076018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76967d-06bb-49ce-ae43-f4846e60b5d3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:46.085081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Fri May 27 09:13:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:13:46.090849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:46.100688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e41d-a336-4287-9f1d-b6121e29eff8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:46.105106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd336559-cb67-4c87-a620-aa89180750af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:46.105971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336559-cb67-4c87-a620-aa89180750af admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:46.106252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336559-cb67-4c87-a620-aa89180750af admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:46.106523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336559-cb67-4c87-a620-aa89180750af admin admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:46.107899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd336559-cb67-4c87-a620-aa89180750af admin admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:46.109780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd336559-cb67-4c87-a620-aa89180750af admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:46.111346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Fri May 27 09:13:46 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:48.394228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180e4b8-f85e-4443-9ad4-d1ad8e99c950 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.394742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180e4b8-f85e-4443-9ad4-d1ad8e99c950 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.394890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180e4b8-f85e-4443-9ad4-d1ad8e99c950 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.396385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:48.402162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.402705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.402705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.404669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f8cb-687d-4b6d-8a01-5e5fb29be29b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.404967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f8cb-687d-4b6d-8a01-5e5fb29be29b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.405269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f8cb-687d-4b6d-8a01-5e5fb29be29b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.406628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:13:48.412763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.413080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.413499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.420367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:48.421835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:48.454183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 09:13:48.454614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 09:13:48.501754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:48.503451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:48.512072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:13:48.538378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:48.566379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:48.610705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:13:48.633609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:48.655349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2700b-b8b2-4cac-82ec-2d4fef818671 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:48.690813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:48.691619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.692171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.692171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.704719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:13:48.716631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:13:48.717545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:13:48.718568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:13:48.724391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:48.771645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9fbfb-8922-411e-9d61-1b8b117ce6cc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:48.774444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:48.815114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:48.816108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.816435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.816717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.823199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:48.844970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf9d1-a68d-4fed-acf6-a34cbdb1e593 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:48.884294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:48.885029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:48.885308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:48.885609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:48.886391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:48.886701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:48.888175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:48.895887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:48.897516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:48.902262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:48.908178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:49.008759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:13:49.015432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:49.019758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:49.027481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2375a-e8e3-4d00-b16e-fddd308737dd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:49.072337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:49.073253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:49.073538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:49.073820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:49.075092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:49.076628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:49.078292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:13:48 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:49.085081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:49.103202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:49.130641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03995940-cff6-4083-aec0-a84329e5f42f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:49.169001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:49.169897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:49.170245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:49.170589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:49.192014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:49.193567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:49.214071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618d569-58ba-4aba-884f-df712b0968cc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:13:49.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:13:49.217158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:13:49.218191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:13:49.218191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:13:49.218191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:13:49.218191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:13:49.218191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:13:49.223858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:49.256308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:49.257139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:49.257425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:49.257699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:49.258920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:49.260436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:49.262061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:49.271448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:49.308884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:49.379846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744879b-212e-4306-ab60-eb0fd3993a8d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:49.391632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:49.417603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a39ad-e1fc-467f-8fd7-4f37cb13000e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:49.425499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:49.426259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:49.426497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:49.426780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:49.427518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:49.427822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:49.429283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483a9b9-d23b-407f-ac03-c41b01da9acd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:49.449864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:49.460008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:49.460855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:49.461236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:49.461599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:49.462569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.domain.id=default, user.id=fc703507b8b64f64800e473a23bfee7e) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:49.462974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:49.464654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36b9a-685d-4b9f-a7ea-58ce4ffd0943 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:49.473142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Fri May 27 09:13:49 2022] GET /identity/v3/role_assignments?user.id=fc703507b8b64f64800e473a23bfee7e&scope.domain.id=default&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 233 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:53.200690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60fd17-5ecc-401a-9311-55fa567955af None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.201488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60fd17-5ecc-401a-9311-55fa567955af None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.201853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60fd17-5ecc-401a-9311-55fa567955af None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.204308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:53.211582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb35f26-5070-4197-86c3-3bac3b46be6c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.212348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb35f26-5070-4197-86c3-3bac3b46be6c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.212853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb35f26-5070-4197-86c3-3bac3b46be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.252201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6fb35f26-5070-4197-86c3-3bac3b46be6c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:53.254268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6fb35f26-5070-4197-86c3-3bac3b46be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:53.385351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 12/23] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:13:53.421498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60fd17-5ecc-401a-9311-55fa567955af None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:53.486233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00fad-9702-4268-81a2-3f0234be903c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.486855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00fad-9702-4268-81a2-3f0234be903c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.487337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00fad-9702-4268-81a2-3f0234be903c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.489757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:13:53.496266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ce4a-833e-492a-bc9d-d691b66b3193 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.496899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ce4a-833e-492a-bc9d-d691b66b3193 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.497499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ce4a-833e-492a-bc9d-d691b66b3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.533721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-58a5ce4a-833e-492a-bc9d-d691b66b3193 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:53.535531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-58a5ce4a-833e-492a-bc9d-d691b66b3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:53.741872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 27 09:13:53.743007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee169-6ac0-4970-9cf8-8e1b2e4a73fa None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.743291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee169-6ac0-4970-9cf8-8e1b2e4a73fa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.743576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee169-6ac0-4970-9cf8-8e1b2e4a73fa None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.745021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 15/26] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:53.756952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.757287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.757528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.785413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:53.805228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:53.807474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:53.833671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60fd17-5ecc-401a-9311-55fa567955af None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:53.897681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:53.963869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:53.964604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:53.965399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:53.965691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:53.966848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:53.968318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:54.017742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 16/27] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:13:54.019828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:54.283713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 12/28] 10.222.0.67 () {60 vars in 1131 bytes} [Fri May 27 09:13:53 2022] POST /identity/v3/roles => generated 225 bytes in 864 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:13:54.286065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:54.323999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728beb5e-a2e7-4178-abfc-334b62842a44 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:54.376628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:54.377647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.377956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.378776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.388120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:54.415774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:13:54.435811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:13:54.436838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:13:54.437589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:13:54.439918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 17/29] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:13:54.448208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:54.523507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244be4-2d86-4607-a1c1-813281b72533 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:54.591197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afee43-40aa-4e06-b78e-7be19b4841a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:54.592214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee43-40aa-4e06-b78e-7be19b4841a4 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.592677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee43-40aa-4e06-b78e-7be19b4841a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.593156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee43-40aa-4e06-b78e-7be19b4841a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.594108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afee43-40aa-4e06-b78e-7be19b4841a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:54.596704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afee43-40aa-4e06-b78e-7be19b4841a4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:54.626658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5bb7f-bf0c-4860-a990-d2a04540c503 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:54.665426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:54.666098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.666384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.666684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.667468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:54.667791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:54.669396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa5361-2a54-4a8a-b67a-7a4d693af9a3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:54.674377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 13/30] 10.222.0.67 () {60 vars in 1131 bytes} [Fri May 27 09:13:54 2022] POST /identity/v3/roles => generated 219 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:13:54.677172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885c241-1dec-4071-9fe0-fb93861a4b8b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.677701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885c241-1dec-4071-9fe0-fb93861a4b8b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.677992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885c241-1dec-4071-9fe0-fb93861a4b8b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.678849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 18/31] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:54.679272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 14/32] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:54.683931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc8de-773a-4a4c-a9eb-e2739fe3d11b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.683931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc8de-773a-4a4c-a9eb-e2739fe3d11b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.683931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc8de-773a-4a4c-a9eb-e2739fe3d11b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.686636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 19/33] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:54.687598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc8de-773a-4a4c-a9eb-e2739fe3d11b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:54.688636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad70d38-bab3-46a1-9931-9793461f8c1f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.689166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad70d38-bab3-46a1-9931-9793461f8c1f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.689661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad70d38-bab3-46a1-9931-9793461f8c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.716622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dad70d38-bab3-46a1-9931-9793461f8c1f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:54.719764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dad70d38-bab3-46a1-9931-9793461f8c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:54.767126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:54.769035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:54.828689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc8de-773a-4a4c-a9eb-e2739fe3d11b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:54.830015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 15/34] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:13:54.833250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.833756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.834235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.857848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:54.859797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:54.884699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:54.886357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:54.890759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:54.890759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:54.890759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:54.891385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:54.899261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 20/35] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:13:54 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:54.899261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:54.971936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 16/36] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:13:54.971936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.050438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a8d8-0e2d-4b16-91d7-b25f201be304 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.079468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:55.091683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.092636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.093140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.093556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.097415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:55.105068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.106560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.107441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e6205-509c-4141-9597-c6c27c90b5fa None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:13:55.127205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:13:55.128136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:13:55.128997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:13:55.128997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:13:55.128997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:13:55.128997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:13:55.128997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 21/37] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:13:55.129273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.144079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890e7bb-de74-4b15-8230-0a289d979d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.144910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890e7bb-de74-4b15-8230-0a289d979d41 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.145198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890e7bb-de74-4b15-8230-0a289d979d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.145494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890e7bb-de74-4b15-8230-0a289d979d41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.146914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890e7bb-de74-4b15-8230-0a289d979d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.148408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890e7bb-de74-4b15-8230-0a289d979d41 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.150017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 17/38] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:55.151194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d657d-314b-482c-894e-fc9bb915a0fe None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.151476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d657d-314b-482c-894e-fc9bb915a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.151752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d657d-314b-482c-894e-fc9bb915a0fe None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.153171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 18/39] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:55.153690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d657d-314b-482c-894e-fc9bb915a0fe None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.237677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bfb2-cd7c-4fdc-ba73-4898643a83ff None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.257425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d657d-314b-482c-894e-fc9bb915a0fe None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.271287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61660912-f829-482d-adad-693bb8293da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.271961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61660912-f829-482d-adad-693bb8293da4 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.272237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61660912-f829-482d-adad-693bb8293da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.272544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61660912-f829-482d-adad-693bb8293da4 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.273295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61660912-f829-482d-adad-693bb8293da4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.274698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61660912-f829-482d-adad-693bb8293da4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.291006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.291668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.296448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.296448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.296448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:55.296448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.296448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.307311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 19/40] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:55.308132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.331870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:55.406938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd1e16-1881-4d85-bf1b-b3d2ff9fc7ef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.441646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.442574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.442887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.443209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] PATH_INFO: `/v3/domains/default/users/fc703507b8b64f64800e473a23bfee7e/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.445486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fc703507b8b64f64800e473a23bfee7e, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.446932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.461772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 22/41] 10.222.0.67 () {60 vars in 1131 bytes} [Fri May 27 09:13:55 2022] POST /identity/v3/roles => generated 223 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:13:55.463265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced875ab-df54-4411-b975-053b9741694b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.463559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced875ab-df54-4411-b975-053b9741694b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.463840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced875ab-df54-4411-b975-053b9741694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.482944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ced875ab-df54-4411-b975-053b9741694b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:55.484562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ced875ab-df54-4411-b975-053b9741694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:55.517603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:55.532362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 20/42] 10.222.0.67 () {58 vars in 1361 bytes} [Fri May 27 09:13:55 2022] PUT /identity/v3/domains/default/users/fc703507b8b64f64800e473a23bfee7e/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:13:55.532362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.577792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 23/43] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:13:55.602341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced875ab-df54-4411-b975-053b9741694b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.646124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:55.673982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b67d0-19dc-40ec-9708-16d271b7d91c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.723893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb905d54-a416-4fb4-8add-bd58e2fb6b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.724096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905d54-a416-4fb4-8add-bd58e2fb6b5f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.724424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905d54-a416-4fb4-8add-bd58e2fb6b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.725905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905d54-a416-4fb4-8add-bd58e2fb6b5f None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.725905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb905d54-a416-4fb4-8add-bd58e2fb6b5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.727396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb905d54-a416-4fb4-8add-bd58e2fb6b5f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.729034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced875ab-df54-4411-b975-053b9741694b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.774157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.775332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.775698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.776055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.777407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.779071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:55.780768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 24/44] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:55.786600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:55.822479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:55.850995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 21/45] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:13:55 2022] POST /identity/v3/projects => generated 301 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:13:55.906537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68280c-9bf4-4839-ac25-54a63a0fa16c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:55.950254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc241219-062f-4361-92ee-558f3059615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:55.950856 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc241219-062f-4361-92ee-558f3059615e None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:55.951143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc241219-062f-4361-92ee-558f3059615e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:55.951421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc241219-062f-4361-92ee-558f3059615e None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:55.952284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc241219-062f-4361-92ee-558f3059615e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:55.953883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc241219-062f-4361-92ee-558f3059615e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:56.053704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 25/46] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:13:55 2022] POST /identity/v3/projects => generated 312 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:13:57.838976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fdf2-62fa-4053-aff2-dff5068735f9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:57.839528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fdf2-62fa-4053-aff2-dff5068735f9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:57.839528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fdf2-62fa-4053-aff2-dff5068735f9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:57.840942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 22/47] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:13:57.846304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:57.846727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:57.846932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:57.864198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:57.865440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:57.931991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 26/48] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:13:57.954929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594fdf2-62fa-4053-aff2-dff5068735f9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.060760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594fdf2-62fa-4053-aff2-dff5068735f9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.097599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.098348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.098632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.098919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.103161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:58.113146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:13:58.122524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:13:58.123496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:13:58.124359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 23/49] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:13:58.130308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.148416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:58.230600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfdf5-8cf6-4836-a52a-a427fbe83a24 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.265508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.266180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.266476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.266756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.267522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:58.267836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:58.269884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0916-01ae-4995-8217-63566b399864 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:58.278509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 27/50] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:58.284238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.286197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199a24-d1d6-4a6b-9b83-0f9507cabe1d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.286493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199a24-d1d6-4a6b-9b83-0f9507cabe1d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.286780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199a24-d1d6-4a6b-9b83-0f9507cabe1d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.288130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 28/51] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:13:58.293501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.293793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.294080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.311095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:13:58.312349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:13:58.379436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 29/52] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:13:58.392977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e605-4493-4ac6-9822-5e7bee8c306b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.403721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.414948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:58.428651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.429568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.429860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.430135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.431320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:58.432906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:58.434778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 24/53] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:13:58 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:13:58.441025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.500682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:58.504025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665768fb-da84-44fe-a8d7-596bee6ea40d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.537330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.538127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.538417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.538697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.539905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:58.541395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:58.542783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d785-d6cf-4c58-a559-53b90bee3322 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.543041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 30/54] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:58.548935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.579607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.580441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.580733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.581015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.582232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:58.583695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:58.585365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 25/55] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:58.590984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:13:58.625586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:58.649057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec3a49-479c-4a25-ba5b-2327b7319902 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.685054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9210eb5-212c-41d9-8c29-4033730208e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.685719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210eb5-212c-41d9-8c29-4033730208e4 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.686012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210eb5-212c-41d9-8c29-4033730208e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.686294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210eb5-212c-41d9-8c29-4033730208e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.687025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9210eb5-212c-41d9-8c29-4033730208e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:58.688519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9210eb5-212c-41d9-8c29-4033730208e4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:58.692964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa483c-40ea-4f3a-ba2b-7f6bfbd96662 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:13:58.721515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:13:58.726587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:13:58.727255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:13:58.727554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:13:58.727841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:13:58.728725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.domain.id=default, user.id=fc703507b8b64f64800e473a23bfee7e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:13:58.729046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:13:58.730503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3bc0-5f62-4bac-af55-8e4cbfae0912 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:13:58.739098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 26/56] 10.222.0.67 () {56 vars in 1322 bytes} [Fri May 27 09:13:58 2022] GET /identity/v3/role_assignments?user.id=fc703507b8b64f64800e473a23bfee7e&scope.domain.id=default&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:13:58.811174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 31/57] 10.222.0.67 () {60 vars in 1140 bytes} [Fri May 27 09:13:58 2022] POST /identity/v3/projects => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:14:01.050557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b443b-a144-4b0a-8f65-8b47e824dcbd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:01.051080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b443b-a144-4b0a-8f65-8b47e824dcbd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:01.051165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b443b-a144-4b0a-8f65-8b47e824dcbd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:01.053500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 27/58] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:01.059077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:01.059553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:01.059642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:01.080078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:01.081417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:01.151717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 32/59] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:01.176469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b443b-a144-4b0a-8f65-8b47e824dcbd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:01.281430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b443b-a144-4b0a-8f65-8b47e824dcbd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:01.315459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4153c2-1f5e-4d06-98f5-ef726441b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:01.316740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4153c2-1f5e-4d06-98f5-ef726441b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:01.317025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4153c2-1f5e-4d06-98f5-ef726441b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:01.317305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4153c2-1f5e-4d06-98f5-ef726441b0a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:01.318536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4153c2-1f5e-4d06-98f5-ef726441b0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:01.320002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4153c2-1f5e-4d06-98f5-ef726441b0a1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:01.321681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 28/60] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:01.327329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:01.388428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:01.442613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b653a-50d6-4950-90bf-806f589b26fa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:01.488192 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d0d23-b151-480a-8804-04b8b1924d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:01.488974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d0d23-b151-480a-8804-04b8b1924d51 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:01.489311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d0d23-b151-480a-8804-04b8b1924d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:01.489641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d0d23-b151-480a-8804-04b8b1924d51 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:01.490412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d0d23-b151-480a-8804-04b8b1924d51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:01.491954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d0d23-b151-480a-8804-04b8b1924d51 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:01.604375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 33/61] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:01 2022] POST /identity/v3/users => generated 275 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:06.244231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33f4d-ce36-45ff-9757-725a6f4083c3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:06.245317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33f4d-ce36-45ff-9757-725a6f4083c3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:06.245817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33f4d-ce36-45ff-9757-725a6f4083c3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:06.247468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 29/62] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:06.254200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e270f-8ce3-49b1-a6bd-bfeb507b378d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:06.255183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e270f-8ce3-49b1-a6bd-bfeb507b378d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:06.255677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e270f-8ce3-49b1-a6bd-bfeb507b378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:06.285508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b03e270f-8ce3-49b1-a6bd-bfeb507b378d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:06.287128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b03e270f-8ce3-49b1-a6bd-bfeb507b378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:06.393422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 34/63] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:06.434737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33f4d-ce36-45ff-9757-725a6f4083c3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:06.540715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:06.602825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33f4d-ce36-45ff-9757-725a6f4083c3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:06.669761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:06.671187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:06.671933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:06.672415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:06.685787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc65df-81db-4eb1-b9bb-a1fd7c8e152b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:06.686213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc65df-81db-4eb1-b9bb-a1fd7c8e152b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:06.686595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc65df-81db-4eb1-b9bb-a1fd7c8e152b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:06.688032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 35/64] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:06.696040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:06.713925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:06.714483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:06.714918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:06.718990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:06.720080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:06.721020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:06.721697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 30/65] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:06.733191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:06.757911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:06.759655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:06.849156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:06.915398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 36/66] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:06.952084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be117-7656-4415-823d-2cb28f28ad66 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:06.967557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.007701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.034370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.035755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.038920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.039465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.040510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:07.041057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:07.047220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea123-994c-42a1-b013-070934953cdc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:07.077774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 31/67] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:07.079581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57a06-947b-4cac-83a0-ad8bf2a532fc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.080961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57a06-947b-4cac-83a0-ad8bf2a532fc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.081573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57a06-947b-4cac-83a0-ad8bf2a532fc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.083432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 32/68] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:07.089065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57a06-947b-4cac-83a0-ad8bf2a532fc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.145343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09741-a60a-4921-a0b5-7289e213ab21 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.190406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090532bb-8061-46a0-b68c-d0c7142b2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.191995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090532bb-8061-46a0-b68c-d0c7142b2b98 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.193167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090532bb-8061-46a0-b68c-d0c7142b2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.193699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090532bb-8061-46a0-b68c-d0c7142b2b98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.211543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090532bb-8061-46a0-b68c-d0c7142b2b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:07.223694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57a06-947b-4cac-83a0-ad8bf2a532fc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-090532bb-8061-46a0-b68c-d0c7142b2b98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:07.223915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:07.224954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:07.225880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:07.227039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 37/69] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:07.228473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.229220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.229585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.254881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:07.256273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:07.281299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.283204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.283683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.284377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.286548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:07.288296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:07.291300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 33/70] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:07.292452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.299757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.361071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 38/71] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:07.363642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.383465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.455344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc317-53d0-4cd4-935f-8e7137877802 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.493634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.494322 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.494614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.494898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.495662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:07.495978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:07.497457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:07.498828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccba04-71d5-490c-88b2-c1a8127f406b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.507298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 34/72] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:07.509036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.546583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.547274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.547565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.547843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.582851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.624274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:07.625840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:07.629055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1e6e4-e3f8-4ab1-8c18-c5a3c806721d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.647233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.669309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c916642-5044-4cc8-b6dc-a76381728cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.670211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916642-5044-4cc8-b6dc-a76381728cdf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.670501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916642-5044-4cc8-b6dc-a76381728cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.670919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916642-5044-4cc8-b6dc-a76381728cdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.684205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c916642-5044-4cc8-b6dc-a76381728cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8c916642-5044-4cc8-b6dc-a76381728cdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:07.693776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:07.694788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:07.696412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 35/73] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:07.698513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba81a5f-d7ac-47e5-9452-45f0b613627d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.698513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba81a5f-d7ac-47e5-9452-45f0b613627d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.698513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba81a5f-d7ac-47e5-9452-45f0b613627d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.698975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 36/74] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:07.700030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01105a-c202-47e8-a4c9-01bbeda4d111 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.700318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01105a-c202-47e8-a4c9-01bbeda4d111 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.700627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01105a-c202-47e8-a4c9-01bbeda4d111 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.702075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 37/75] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:07.704442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01105a-c202-47e8-a4c9-01bbeda4d111 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.744708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 39/76] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:07.745832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:07.814408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.820009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01105a-c202-47e8-a4c9-01bbeda4d111 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.858331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8b612-6868-4e2f-9f02-b62f31f06193 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:07.858609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f779ee-9583-4cde-95ab-f984402966ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.859378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f779ee-9583-4cde-95ab-f984402966ab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.859666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f779ee-9583-4cde-95ab-f984402966ab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.859958 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f779ee-9583-4cde-95ab-f984402966ab None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.877734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f779ee-9583-4cde-95ab-f984402966ab None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:07.879243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f779ee-9583-4cde-95ab-f984402966ab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:07.881044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 38/77] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:07.882411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.882705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.882989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.900841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:07.901380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:07.902058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.902183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:07.902345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.902626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.903377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:07.903690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:07.905130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8aff-46c6-4055-bebf-a5673c99f0ec None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:07.920304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 40/78] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:07.922369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:07.922763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:07.923095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:07.933238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:07.944032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:07.945490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:07.978783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 39/79] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:07.979690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.038141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 41/80] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:08.039029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.093733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca23e56-3321-4768-8b06-01a6635bba08 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.099580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.131593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.132511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.132806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.133079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.134377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.135906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.137688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 40/81] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:07 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:08.138493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.147177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba070-bccb-41d9-9b24-679dd7eaa11f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.174831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.182722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.185991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.185991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.185991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.261928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdd72c-f23b-46ea-9058-7e29ef5be206 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.273442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.275873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.309339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.310159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.310450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.310731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.311986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.313515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.320229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 41/82] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:08.320229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.342935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.392125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 42/83] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:08.393057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.425077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.429129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e1dd-bf96-45e2-a953-5613c93664b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.464944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.465759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.466052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.466335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.467590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.469135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.470797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 42/84] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:08.471584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.498548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084c5ad-daf2-466f-a9fe-4fcc15ecaa10 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.536342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.537361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.537851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.538204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.550018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:08.558711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:08.559859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 43/85] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:08.561983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.585205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.586165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fecd22-65ec-4aa1-b1e9-b7de2fd87e28 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.624685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.625359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.625649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.625933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.626883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=fc703507b8b64f64800e473a23bfee7e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:08.627204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.628736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.635237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 43/86] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/role_assignments?user.id=fc703507b8b64f64800e473a23bfee7e&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:08.636141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.676691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.692262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9a3d9-5edd-4067-bec9-4ff113281de2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.744550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.745238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.745532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.745815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.764730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cd451-6a96-4c26-9dbb-f3d90ec3b817 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.812486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:08.813685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:08.814199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:08.814485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:08.816427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.818107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.820754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 44/87] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:08.822178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:08.848627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:08.850281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:08.871880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.972283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:08.975604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c317d-5e64-4d93-8889-f54faa4080f9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:08.995697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 44/88] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:08.997156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:09.032380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.033377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.033829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.034297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:09.035553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:09.038121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:09.129860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804f062-b813-409c-a1c5-0328ecfe2abf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:09.132297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 45/89] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:08 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:09.140052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:09.154589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:09.178027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.178633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.178769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.179056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:09.179969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:09.180288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:09.181867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:09.194332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 45/90] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:09.195238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:09.349477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45d5fd-7b1a-43b1-bee5-e17f3af11910 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:09.361846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340316-b41c-4a3c-a9b0-d397d5d9b58f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:09.406969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.407740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.408841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.408841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:09.409510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=664e79cef1de4a619d1bcc1b9e9326ef) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:09.410458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:09.412088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:09.419446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 46/91] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:09 2022] GET /identity/v3/role_assignments?user.id=664e79cef1de4a619d1bcc1b9e9326ef&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=d132772f9a6144b996dae740722fe305 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:09.420447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:09.444741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.447060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.447726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.448369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:09.450675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:09.453942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:09.457959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:09.468657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 46/92] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:09 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:09.471958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:09.555452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de0bd1-ff85-4e75-9bd2-484399718c28 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:09.568829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:09.598742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.600086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.600571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.600571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:09.602114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:09.603726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:09.605705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 47/93] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:09 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:09.615143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:09.694302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692f7e6-21f2-42a7-9d88-b5ffa167a8af None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:09.771698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.774770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.775298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.775782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:09.777691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] RBAC: Adding query filter params (role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=664e79cef1de4a619d1bcc1b9e9326ef) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:09.778239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:09.781316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:09.794127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 47/94] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:09 2022] GET /identity/v3/role_assignments?user.id=664e79cef1de4a619d1bcc1b9e9326ef&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:09.818612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:09.842587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb79648-034a-4bfa-86f0-07ada74bfb54 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:09.911496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:09.912862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:09.913594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:09.914328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:10.088721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:10.091603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:10.266114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:10.291441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 48/95] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:14:10.302647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:10.488743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e282fa7-8639-47b0-bdbd-5ae2748472bf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:10.513511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:10.536317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680abf1f-ed1e-41b7-bcc2-ba367d5e4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:10.537241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680abf1f-ed1e-41b7-bcc2-ba367d5e4176 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:10.537534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680abf1f-ed1e-41b7-bcc2-ba367d5e4176 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:10.537820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680abf1f-ed1e-41b7-bcc2-ba367d5e4176 None admin] PATH_INFO: `/v3/projects/970f309bf8124ede82bebbcbedb7ef2a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:10.539228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680abf1f-ed1e-41b7-bcc2-ba367d5e4176 None admin] RBAC: Authorizing `identity:get_project(project_id=970f309bf8124ede82bebbcbedb7ef2a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:10.540821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680abf1f-ed1e-41b7-bcc2-ba367d5e4176 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:10.542707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 48/96] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:10 2022] GET /identity/v3/projects/970f309bf8124ede82bebbcbedb7ef2a => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:10.555261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:10.778392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a289b8-3dbf-4062-87ac-1a6ad165fd6d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:10.830197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:10.830904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:10.831206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:10.831499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:10.832523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, scope.project.id=970f309bf8124ede82bebbcbedb7ef2a, user.id=664e79cef1de4a619d1bcc1b9e9326ef) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:10.832851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:10.834354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bbf3-7943-45eb-bb8c-a097ad7c68a6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:10.845656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 49/97] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:10 2022] GET /identity/v3/role_assignments?user.id=664e79cef1de4a619d1bcc1b9e9326ef&scope.project.id=970f309bf8124ede82bebbcbedb7ef2a&role.id=d132772f9a6144b996dae740722fe305 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:11.352348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cf0e1-f088-4048-adb5-b9d8d64e575d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:11.352804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cf0e1-f088-4048-adb5-b9d8d64e575d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:11.352940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cf0e1-f088-4048-adb5-b9d8d64e575d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:11.354639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 49/98] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:11.360466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:11.360887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:11.361109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:11.379515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:11.380867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:11.453984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:11.483105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 50/99] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:11.517420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cf0e1-f088-4048-adb5-b9d8d64e575d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:11.638753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cf0e1-f088-4048-adb5-b9d8d64e575d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:11.682752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:11.683590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:11.683879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:11.684166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:11.702538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:11.710942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:11.713371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:11.714901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 50/100] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:11.721827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:11.863899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf10581-3b42-4c54-930d-3838a9134b84 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:11.930991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:11.931690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:11.931960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:11.932252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:11.933087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:11.933404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:11.934884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:11.949814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 51/101] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:11.955504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:12.057034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:12.249720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bae5c-740d-4cc6-8534-a4310b472237 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:12.341087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:12.342393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:12.342887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:12.343371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:12.344969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:12.346694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:12.349621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 51/102] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:11 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:12.357475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:12.440397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:12.517848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812647b-2f95-46e9-a37e-493976bf1d18 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:12.564855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d22ef1-fc77-4c42-bf40-d03b737f64b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:12.565748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22ef1-fc77-4c42-bf40-d03b737f64b6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:12.566581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22ef1-fc77-4c42-bf40-d03b737f64b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:12.566870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22ef1-fc77-4c42-bf40-d03b737f64b6 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:12.573333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d22ef1-fc77-4c42-bf40-d03b737f64b6 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:12.574876 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d22ef1-fc77-4c42-bf40-d03b737f64b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:12.576971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 52/103] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:12 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:12.583621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:12.766868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ea487-6326-4ffe-b468-0e9817a68c34 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:12.776547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:12.817013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774d91-f57f-41eb-8762-f6a48ca89252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:12.817945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774d91-f57f-41eb-8762-f6a48ca89252 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:12.818238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774d91-f57f-41eb-8762-f6a48ca89252 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:12.818520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774d91-f57f-41eb-8762-f6a48ca89252 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/fc703507b8b64f64800e473a23bfee7e/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:12.826306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774d91-f57f-41eb-8762-f6a48ca89252 None admin] RBAC: Authorizing `identity:create_grant(project_id=d552fcbcb9b147e292f8c10cf6ecfe72, user_id=fc703507b8b64f64800e473a23bfee7e, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:12.827937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774d91-f57f-41eb-8762-f6a48ca89252 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:12.913492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 52/104] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:12 2022] PUT /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/fc703507b8b64f64800e473a23bfee7e/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:13.428028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7630a-da1a-46d6-b6fe-60d564f0c6a8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:13.428841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7630a-da1a-46d6-b6fe-60d564f0c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:13.428841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7630a-da1a-46d6-b6fe-60d564f0c6a8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:13.430422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 53/105] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:13.437664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae56c-dce8-4910-b911-33372ecbb73e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:13.438044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae56c-dce8-4910-b911-33372ecbb73e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:13.438290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae56c-dce8-4910-b911-33372ecbb73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:13.459077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4daae56c-dce8-4910-b911-33372ecbb73e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:13.460365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4daae56c-dce8-4910-b911-33372ecbb73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:13.563479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 53/106] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 27 09:14:13.609013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7630a-da1a-46d6-b6fe-60d564f0c6a8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:13.690705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20ad7-9d57-431c-8340-45b1c4a556f6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:13.691756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20ad7-9d57-431c-8340-45b1c4a556f6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:13.692244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20ad7-9d57-431c-8340-45b1c4a556f6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:13.694172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 54/107] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:13.711536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:13.712452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:13.712945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:13.741447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:13.743074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:13.800611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7630a-da1a-46d6-b6fe-60d564f0c6a8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:13.828894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:13.872097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:13.874048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:13.874812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:13.875523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:13.892129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 55/108] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:13.901671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:13.918170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:13.920102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:13.922152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:13.926101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 54/109] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:13.932730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:13.934388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:13.964488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:14.056379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3f48d-cc2a-41b0-b158-a04712e3ea5a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:14.104449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:14.106064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:14.106917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:14.107404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:14.108432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:14.108970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:14.110622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:14.127229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 56/110] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:14.129085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:14.203067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8b53e-eb6b-4c82-bff5-efd25dc4330c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:14.278506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:14.279352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:14.279706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:14.279998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:14.301805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:14.304570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:14.315381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:14.321331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:14.322481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 55/111] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:14.329752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:14.385035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:14.392377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a695ba-e369-47de-b5d4-c76f00de5217 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:14.512227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024bba2-cb70-4a81-a01a-7df7b8e39db5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:14.540376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:14.540829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:14.541430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:14.542031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:14.548355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:14.548355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:14.558303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 57/112] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:14 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:14.564601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:14.590712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:14.591905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:14.592447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:14.592967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:14.594361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:14.595207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:14.598546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:14.630254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 56/113] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:14.645163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:14.915299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbbfa8-69b4-4d83-82b9-78ec3a01595c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:14.924742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:14.945925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425bdc5-e4b2-43bd-92c2-96f673ff1c20 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:15.010054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc162f-dabd-4ccb-9fbd-0dc4105de1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:15.011622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc162f-dabd-4ccb-9fbd-0dc4105de1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.012122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc162f-dabd-4ccb-9fbd-0dc4105de1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.014367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc162f-dabd-4ccb-9fbd-0dc4105de1b5 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.016979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc162f-dabd-4ccb-9fbd-0dc4105de1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:15.020292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc162f-dabd-4ccb-9fbd-0dc4105de1b5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:15.026378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 58/114] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:14 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:15.028737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91d69-84d8-4d1f-93ae-92597b6ea1d3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.029253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91d69-84d8-4d1f-93ae-92597b6ea1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.029764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91d69-84d8-4d1f-93ae-92597b6ea1d3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.032250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 59/115] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:15.043499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91d69-84d8-4d1f-93ae-92597b6ea1d3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:15.099030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:15.126646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17847c-06a1-4c7b-87da-0a118b26221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:15.128113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17847c-06a1-4c7b-87da-0a118b26221b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.128656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17847c-06a1-4c7b-87da-0a118b26221b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.129126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17847c-06a1-4c7b-87da-0a118b26221b None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.135452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17847c-06a1-4c7b-87da-0a118b26221b None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:15.138501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17847c-06a1-4c7b-87da-0a118b26221b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:15.142001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 57/116] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:14 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:15.166650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.167249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.167780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.228684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:15.230418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:15.346980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91d69-84d8-4d1f-93ae-92597b6ea1d3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:15.389433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e61ef-1713-465e-bca0-9452d023eaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:15.390359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e61ef-1713-465e-bca0-9452d023eaa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.390648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e61ef-1713-465e-bca0-9452d023eaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.390933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e61ef-1713-465e-bca0-9452d023eaa4 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/664e79cef1de4a619d1bcc1b9e9326ef/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.393327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e61ef-1713-465e-bca0-9452d023eaa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d552fcbcb9b147e292f8c10cf6ecfe72, user_id=664e79cef1de4a619d1bcc1b9e9326ef, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:15.394906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e61ef-1713-465e-bca0-9452d023eaa4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:15.399701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 58/117] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:15.402194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:15.497590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 60/118] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:15 2022] PUT /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/664e79cef1de4a619d1bcc1b9e9326ef/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:15.499395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604def6e-cf2d-49ee-a3d2-91fd058d5b4a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.499832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604def6e-cf2d-49ee-a3d2-91fd058d5b4a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.500282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604def6e-cf2d-49ee-a3d2-91fd058d5b4a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.502134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 61/119] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:15.503448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84daf4a-8322-427b-bd8c-6244adc808a3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.503878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84daf4a-8322-427b-bd8c-6244adc808a3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.504286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84daf4a-8322-427b-bd8c-6244adc808a3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.512721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 62/120] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:15.512721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84daf4a-8322-427b-bd8c-6244adc808a3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:15.539078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:15.551216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb612b-813c-4f4e-bf73-c6640e4871ef None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:15.595802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc99a9-cccf-4b6c-8f3b-e93d32441a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:15.596950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc99a9-cccf-4b6c-8f3b-e93d32441a1f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.597983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc99a9-cccf-4b6c-8f3b-e93d32441a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.598730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc99a9-cccf-4b6c-8f3b-e93d32441a1f None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.601815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc99a9-cccf-4b6c-8f3b-e93d32441a1f None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:15.602454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc99a9-cccf-4b6c-8f3b-e93d32441a1f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:15.605525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 59/121] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:15 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:15.607311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd29b08-00cc-490b-8eb5-0a942a70604c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.607863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd29b08-00cc-490b-8eb5-0a942a70604c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.608368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd29b08-00cc-490b-8eb5-0a942a70604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.631018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0bd29b08-00cc-490b-8eb5-0a942a70604c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:15.632683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0bd29b08-00cc-490b-8eb5-0a942a70604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:15.728367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 60/122] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:15.728367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.728367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.728367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.732781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:15.760378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:15.763292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:15.771748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84daf4a-8322-427b-bd8c-6244adc808a3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:15.822576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:15.823393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:15.823726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:15.824010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:15.825446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:15.827173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:15.829063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 63/123] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:15.829983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:15.904046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 61/124] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:15.906242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:15.950101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:16.019245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03540-0498-4671-a742-5e6e5c0dce27 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:16.082908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:16.084564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.085119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.085699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/664e79cef1de4a619d1bcc1b9e9326ef/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.090280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] RBAC: Authorizing `identity:create_grant(project_id=d552fcbcb9b147e292f8c10cf6ecfe72, user_id=664e79cef1de4a619d1bcc1b9e9326ef, role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:16.092977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:16.110445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec94a6-8678-49ec-9bd2-d21b93861ef4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:16.149166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:16.150000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.150288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.150566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.163848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:16.172438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:16.173497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 62/125] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:16.181192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:16.187966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 64/126] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:15 2022] PUT /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/664e79cef1de4a619d1bcc1b9e9326ef/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:16.196156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:16.227870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:16.374514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:16.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e77f4-68da-49a6-b1de-4762b4c9d203 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:16.428318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022663-3d2a-4f3f-aadc-fe1da79b8378 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:16.480355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725b957-a7ca-4f3c-90ba-b9624a939679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:16.480355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725b957-a7ca-4f3c-90ba-b9624a939679 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.480355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725b957-a7ca-4f3c-90ba-b9624a939679 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.480355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725b957-a7ca-4f3c-90ba-b9624a939679 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.494366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:16.495056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.495346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.495627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.496395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:16.497734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725b957-a7ca-4f3c-90ba-b9624a939679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:16.497927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0725b957-a7ca-4f3c-90ba-b9624a939679 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:16.515024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:16.516155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:16.516973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:16.518042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 65/127] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:16.520134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d849-7430-4e45-8996-a5981f12e127 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.520810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d849-7430-4e45-8996-a5981f12e127 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.521156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d849-7430-4e45-8996-a5981f12e127 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.523735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 66/128] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:16.532728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d849-7430-4e45-8996-a5981f12e127 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:16.603184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 63/129] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:14:16 2022] POST /identity/v3/projects => generated 302 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:16.608354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:16.746083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:16.799064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c42f-4627-4673-bb5b-fe5d40dc92ae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:16.844215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:16.854272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:16.855505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.856033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.856692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.857710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:16.858197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:16.859830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f096c-be31-4a47-a848-0fdbb6cc3102 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:16.871746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 64/130] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:16.880939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:16.881570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:16.882056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:16.884704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d849-7430-4e45-8996-a5981f12e127 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:16.910531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:16.913149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:17.025118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.026185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.026669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.027177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:17.030346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:17.030709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:17.032845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 65/131] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:17.034151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.041695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:17.089337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 67/132] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:17.098642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.224708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35d6b-b469-4f38-9e63-e829472a9a12 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:17.281788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:17.305633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.305633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.305633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.306141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819452a-3a6d-41e0-947f-1271ca1b8de3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:17.308362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:17.316363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:17.317896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:17.320077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 66/133] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:17 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:17.321098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.367506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.368445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.369717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.369972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] PATH_INFO: `/v3/users/f88a073696cb40088235a150006ceb69` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:17.375610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:17.400391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] RBAC: Authorizing `identity:get_user(user_id=f88a073696cb40088235a150006ceb69)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:17.402013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:17.406524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 68/134] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:17 2022] GET /identity/v3/users/f88a073696cb40088235a150006ceb69 => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:17.408463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.517447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91142-d315-49bb-ad00-8a29223fb76c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:17.609220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.610189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.610189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.610658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:17.617853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359af11-e7d8-4cce-b8f7-d514779a0b2a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:17.630739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:17.647594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:17.649212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:17.650605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:17.657026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 67/135] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:17.657394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.658030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.658293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.658604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.658901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] PATH_INFO: `/v3/projects/970f309bf8124ede82bebbcbedb7ef2a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:17.660791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] RBAC: Authorizing `identity:get_project(project_id=970f309bf8124ede82bebbcbedb7ef2a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:17.662296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:17.664389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 69/136] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:17 2022] GET /identity/v3/projects/970f309bf8124ede82bebbcbedb7ef2a => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:17.665866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.732484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:17.780812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:17.815938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e55b8-864d-4cf3-a424-e9438bdbfd29 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:17.819855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ba9b6-ea57-4187-8636-c7c9a7622aeb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:17.910505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.911397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.911694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.911987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:17.912818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:17.913137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:17.914591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:17.925279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 70/137] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:17.926906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:17.954495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:17.956027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:17.957452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:17.958296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:18.048359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98992c6-075d-4ac7-90e7-3abd4ac9218d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:18.068600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:18.086406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:18.088724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:18.093297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:18.094267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] PATH_INFO: `/v3/projects/970f309bf8124ede82bebbcbedb7ef2a/users/664e79cef1de4a619d1bcc1b9e9326ef/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:18.101330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] RBAC: Authorizing `identity:create_grant(project_id=970f309bf8124ede82bebbcbedb7ef2a, user_id=664e79cef1de4a619d1bcc1b9e9326ef, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:18.111424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:18.183471 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:18.186949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:18.205432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 71/138] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:17 2022] PUT /identity/v3/projects/970f309bf8124ede82bebbcbedb7ef2a/users/664e79cef1de4a619d1bcc1b9e9326ef/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:18.212364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:18.288452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:18.435674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 68/139] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:18.444866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:18.548108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378efd2-fa9e-4e2c-b1b5-5faead156807 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:18.629958 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619c99e-e1ae-4d83-b64c-350357de068a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:18.665436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:18.666783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:18.667274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:18.667860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] PATH_INFO: `/v3/users/fc703507b8b64f64800e473a23bfee7e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:18.669870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] RBAC: Authorizing `identity:get_user(user_id=fc703507b8b64f64800e473a23bfee7e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:18.671409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:18.674786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 72/140] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:18 2022] GET /identity/v3/users/fc703507b8b64f64800e473a23bfee7e => generated 247 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:18.676096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:18.677018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:18.677301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:18.677582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:18.678937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:18.680489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:18.682299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 69/141] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:18 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:18.683323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:18.693223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:18.725477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:18.785757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:18.840864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b8e04-41ef-4f4d-b944-37e9e9ea84cf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:18.894189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:18.894893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:18.895179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:18.895462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:18.896570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] RBAC: Adding query filter params (role.id=eb2759eb02bc4973bf7af21b8c09d305, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=f88a073696cb40088235a150006ceb69) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:18.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:18.898405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:18.914540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 70/142] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:18 2022] GET /identity/v3/role_assignments?user.id=f88a073696cb40088235a150006ceb69&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=eb2759eb02bc4973bf7af21b8c09d305 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:18.931668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752da01-6b00-4aba-a12f-4d734fb25106 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:18.994319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f217cf6-5b56-48dc-9b3b-d43120a66cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:18.994887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217cf6-5b56-48dc-9b3b-d43120a66cca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:18.995155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217cf6-5b56-48dc-9b3b-d43120a66cca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:18.995443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217cf6-5b56-48dc-9b3b-d43120a66cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:19.084725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f217cf6-5b56-48dc-9b3b-d43120a66cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:19.086287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f217cf6-5b56-48dc-9b3b-d43120a66cca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:19.146447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:19.214624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 73/143] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:19.224192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:19.283411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c95651-75e1-411e-8c53-e66cdd0db29f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:19.284436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c95651-75e1-411e-8c53-e66cdd0db29f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:19.285246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c95651-75e1-411e-8c53-e66cdd0db29f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:19.288263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 74/144] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:19.297748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:19.298643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:19.299608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:19.336519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:19.339020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:19.380710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:19.427664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364389-a69a-48d2-8fd5-833d08a43281 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:19.508448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:19.510902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:19.511638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:19.512995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:19.515295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:19.518293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:19.521434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 71/145] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:19 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:19.530282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 75/146] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:19.531331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:19.579201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:19.864822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:19.896440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264a98-6fde-456e-98d8-1ca21d8a275a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:19.932550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e2879-d776-4428-87e5-81245ab7b807 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:19.956259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4ba57-0f82-44e3-b36a-ecf5ade7d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:19.957146 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ba57-0f82-44e3-b36a-ecf5ade7d628 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:19.957430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ba57-0f82-44e3-b36a-ecf5ade7d628 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:19.957739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ba57-0f82-44e3-b36a-ecf5ade7d628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:19.983961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4ba57-0f82-44e3-b36a-ecf5ade7d628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f7d4ba57-0f82-44e3-b36a-ecf5ade7d628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:20.003813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:20.004816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:20.006069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 76/147] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:20.007392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81287-8857-4406-8e31-9d8e32243376 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.007756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81287-8857-4406-8e31-9d8e32243376 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.008045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81287-8857-4406-8e31-9d8e32243376 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.009569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 77/148] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:20.021456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:20.021840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.022134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.022415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.022643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.023254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.023748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.025694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=fc703507b8b64f64800e473a23bfee7e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:20.026267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:20.029383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:20.044806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:20.046228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:20.052085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 72/149] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:19 2022] GET /identity/v3/role_assignments?user.id=fc703507b8b64f64800e473a23bfee7e&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:20.053707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:20.122377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:20.183348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 78/150] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:20.225972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:20.329083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:20.371681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd98c-7e08-408d-9a0b-bd3b2912548f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:20.423645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:20.424436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.424728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.425082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.450439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18f29-28d8-4b09-94dd-3e080945c897 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:20.453608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:20.464907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:20.466015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:20.467386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 79/151] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:20.476560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:20.537751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:20.538996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.539540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.540054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.541131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:20.541664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:20.543306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:20.563973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 73/152] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:20.572458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:20.645755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6bb11-b103-4f29-947c-3952704316e2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:20.686758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:20.700937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:20.708304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.708304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.708304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.708304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:20.708304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:20.708304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:20.715197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 80/153] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:20.720339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:20.723138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:20.769968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0b9b6-e496-4ae2-a0d3-8d0448ac5f7c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:20.815434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:20.817306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.817802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.818298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.819921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:20.821738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:20.823697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 74/154] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:20.830874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:20.927042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d309ee-eb15-4d2e-b63e-c8c44c6f8701 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:20.961984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93893c9-1656-48c3-9e07-3e81b779550f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:20.967142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae2ab8-dc4c-4d01-a16f-170bf67ad685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:20.968040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2ab8-dc4c-4d01-a16f-170bf67ad685 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.968336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2ab8-dc4c-4d01-a16f-170bf67ad685 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.968627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2ab8-dc4c-4d01-a16f-170bf67ad685 None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.969898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2ab8-dc4c-4d01-a16f-170bf67ad685 None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:20.971392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2ab8-dc4c-4d01-a16f-170bf67ad685 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:20.973272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 81/155] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:20.976817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3424-253a-4d26-9b4f-e9b0648f4cf9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:20.976817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3424-253a-4d26-9b4f-e9b0648f4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:20.976817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3424-253a-4d26-9b4f-e9b0648f4cf9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:20.976817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 82/156] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:20.986713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d3424-253a-4d26-9b4f-e9b0648f4cf9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.017370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa282d-25b6-4749-8033-d8d91b3e34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.018025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa282d-25b6-4749-8033-d8d91b3e34ae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.018318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa282d-25b6-4749-8033-d8d91b3e34ae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.018595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa282d-25b6-4749-8033-d8d91b3e34ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.036915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.056365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.100664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa282d-25b6-4749-8033-d8d91b3e34ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.102394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa282d-25b6-4749-8033-d8d91b3e34ae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.109994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d3424-253a-4d26-9b4f-e9b0648f4cf9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.147791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.148646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.149034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.149425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.219952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 75/157] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:21.221723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.222165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.222670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.225580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.227212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.244099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:21.245765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:21.295945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.301342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.336974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 76/158] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:21.339198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.348400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 83/159] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:21.351992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.464665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79621db6-d9ae-4d00-8c36-4924978ed9ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.479447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76edc37-93f5-4b91-a8bb-3e7bcbfb4cdf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.503170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.505273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.505439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.505747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.507180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.508816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.510774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 84/160] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:21 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:21.516536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.522419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.523602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.524066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.524559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.526052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.527913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.529930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 77/161] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:21 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:21.531047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.551261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.584721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.638556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e12ca-a5a7-4432-b645-685ec3e94e7d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.654816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740db2-faed-4931-8f36-3e317a29552b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.678934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.679879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.680232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.680606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.682401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.684020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.685871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 85/162] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:21.690387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.702078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.703232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.703720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.704195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.705397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] RBAC: Adding query filter params (role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=664e79cef1de4a619d1bcc1b9e9326ef) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:21.705921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.708291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.715678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 78/163] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:21 2022] GET /identity/v3/role_assignments?user.id=664e79cef1de4a619d1bcc1b9e9326ef&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:21.716961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:21.837031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f257-1357-4225-a1fd-5576f34fb5be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.848049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.851089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:21.854398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f16ab-6c31-41de-ba61-c7517b1fa1d9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:21.883685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.884862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.885432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.885917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.887007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.888872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.892537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:21.893206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.893497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.893779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.895178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=664e79cef1de4a619d1bcc1b9e9326ef) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:21.895603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:21.897052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58367ead-fc88-4f07-b1e2-f6da43290be8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:21.904559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 86/164] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:21 2022] GET /identity/v3/role_assignments?user.id=664e79cef1de4a619d1bcc1b9e9326ef&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=d132772f9a6144b996dae740722fe305 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:21.911448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e80b70-779e-4528-990e-239261a3970a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.912286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e80b70-779e-4528-990e-239261a3970a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.914559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e80b70-779e-4528-990e-239261a3970a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.916900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 87/165] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:21.925141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:21.925803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:21.926290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:21.951044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:21.952563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:21.999884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 79/166] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:21 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:22.066775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 88/167] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:22.093709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:22.224985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83898b2-da92-4205-a657-a63dbed5e750 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:22.271447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:22.272289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:22.272658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:22.272937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:22.286239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:22.294395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:22.295488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:22.296341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 80/168] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:22.308423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:22.444602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:22.462578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5addb-035f-46c2-8baa-6b40389d02c1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:22.515050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:22.515741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:22.516030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:22.516312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:22.517126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:22.517439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:22.518898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:22.529067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 89/169] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:22.534738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:22.567915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:22.674177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fc7d3-ca3d-4b01-bf1e-71005020b0d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:22.744891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5820f-1dd2-4335-af97-3e5b5e32ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:22.745892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5820f-1dd2-4335-af97-3e5b5e32ecbc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:22.746189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5820f-1dd2-4335-af97-3e5b5e32ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:22.746473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5820f-1dd2-4335-af97-3e5b5e32ecbc None admin] PATH_INFO: `/v3/users/664e79cef1de4a619d1bcc1b9e9326ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:22.749001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5820f-1dd2-4335-af97-3e5b5e32ecbc None admin] RBAC: Authorizing `identity:get_user(user_id=664e79cef1de4a619d1bcc1b9e9326ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:22.750656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5820f-1dd2-4335-af97-3e5b5e32ecbc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:22.752669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 81/170] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:22 2022] GET /identity/v3/users/664e79cef1de4a619d1bcc1b9e9326ef => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:22.759201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:22.940202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5660a7-8809-4f91-b5c1-8816eafb3245 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:22.942300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d587a-f1a4-47aa-8c1d-8f334c0ba44b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:22.942826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d587a-f1a4-47aa-8c1d-8f334c0ba44b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:22.943394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d587a-f1a4-47aa-8c1d-8f334c0ba44b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:22.949324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 82/171] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:22.955598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:22.956213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:22.956834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:22.993641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:22.995300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:23.017425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:23.017425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:23.017425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:23.017425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:23.060873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:23.133171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 83/172] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:23.159727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:23.162199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:23.181739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:23.219281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:23.341657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646362a-c70d-4c62-94ae-14301811b1eb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:23.383343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 90/173] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:23.387480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:23.389371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:23.390529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:23.390848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:23.391127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:23.418396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:23.426926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:23.427818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:23.428660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 84/174] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:23.435728 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:23.513061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:23.556972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:23.588267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e3e9-3114-402c-bbe3-3c5a7e9374e1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:23.632937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:23.634180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:23.634674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:23.635221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:23.636523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:23.637191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:23.638735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014db8c4-4f59-4e14-90e8-4176e6eeb7b8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:23.639528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:23.653780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 85/175] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:23.663921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:23.708812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:23.710120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:23.714762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:23.715081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] PATH_INFO: `/v3/projects/970f309bf8124ede82bebbcbedb7ef2a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:23.716653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] RBAC: Authorizing `identity:get_project(project_id=970f309bf8124ede82bebbcbedb7ef2a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:23.718293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:23.720383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 91/176] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:23 2022] GET /identity/v3/projects/970f309bf8124ede82bebbcbedb7ef2a => generated 312 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:23.726717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:23.820105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bdb7b-7a11-4894-a2a6-d531564da409 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:23.869738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:23.871057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:23.873209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:23.873740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] PATH_INFO: `/v3/users/f88a073696cb40088235a150006ceb69` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:23.877171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] RBAC: Authorizing `identity:get_user(user_id=f88a073696cb40088235a150006ceb69)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:23.879547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:23.881875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 86/177] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:23 2022] GET /identity/v3/users/f88a073696cb40088235a150006ceb69 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:23.889785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:23.909383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:24.019227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c5c1-f945-4392-afff-5c5d8d0d3d91 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:24.051985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cedf0-c8f1-40fe-9e7e-6b7f41e0e870 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:24.067225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:24.084490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:24.086019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:24.086490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:24.087193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:24.088219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, scope.project.id=970f309bf8124ede82bebbcbedb7ef2a, user.id=664e79cef1de4a619d1bcc1b9e9326ef) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:24.088760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:24.090791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:24.098710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 92/178] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:23 2022] GET /identity/v3/role_assignments?user.id=664e79cef1de4a619d1bcc1b9e9326ef&scope.project.id=970f309bf8124ede82bebbcbedb7ef2a&role.id=d132772f9a6144b996dae740722fe305 => generated 608 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:24.148643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaa871-dd0a-4ea0-a548-7ed20fdb4e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:24.149515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaa871-dd0a-4ea0-a548-7ed20fdb4e96 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:24.149812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaa871-dd0a-4ea0-a548-7ed20fdb4e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:24.150088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaa871-dd0a-4ea0-a548-7ed20fdb4e96 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:24.157384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaa871-dd0a-4ea0-a548-7ed20fdb4e96 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:24.159001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaa871-dd0a-4ea0-a548-7ed20fdb4e96 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:24.161466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 87/179] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:23 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:24.167170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:24.333249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a47a6-aded-47c6-8806-66b6eb4f06b0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:24.372219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae65b0-29a1-48b6-b89f-b4ad0dfb4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:24.373159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae65b0-29a1-48b6-b89f-b4ad0dfb4027 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:24.373443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae65b0-29a1-48b6-b89f-b4ad0dfb4027 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:24.373719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae65b0-29a1-48b6-b89f-b4ad0dfb4027 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/f88a073696cb40088235a150006ceb69/roles/eb2759eb02bc4973bf7af21b8c09d305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:24.375854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae65b0-29a1-48b6-b89f-b4ad0dfb4027 None admin] RBAC: Authorizing `identity:create_grant(project_id=d552fcbcb9b147e292f8c10cf6ecfe72, user_id=f88a073696cb40088235a150006ceb69, role_id=eb2759eb02bc4973bf7af21b8c09d305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:24.377416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae65b0-29a1-48b6-b89f-b4ad0dfb4027 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:24.452368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 93/180] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:24 2022] PUT /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/users/f88a073696cb40088235a150006ceb69/roles/eb2759eb02bc4973bf7af21b8c09d305 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:24.876816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7b1d-485e-4298-ba57-b285e7b0386f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:24.877204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7b1d-485e-4298-ba57-b285e7b0386f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:24.877397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7b1d-485e-4298-ba57-b285e7b0386f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:24.878971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 88/181] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:24.885167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:24.885686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:24.886134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:24.905729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:24.907267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:24.954341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:24.985154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 94/182] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:25.008535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae7b1d-485e-4298-ba57-b285e7b0386f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.156521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:25.181434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae7b1d-485e-4298-ba57-b285e7b0386f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:25.221690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c219b9d-d39a-450d-8ba6-0d0599f419b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:25.223531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219b9d-d39a-450d-8ba6-0d0599f419b3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.224091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219b9d-d39a-450d-8ba6-0d0599f419b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.224614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219b9d-d39a-450d-8ba6-0d0599f419b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.238635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c219b9d-d39a-450d-8ba6-0d0599f419b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0c219b9d-d39a-450d-8ba6-0d0599f419b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:25.246877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:25.247843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:25.248684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 89/183] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:25.255342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.278962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c41e-1b2d-4c8a-ae80-d8e162fd4ea5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.278962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c41e-1b2d-4c8a-ae80-d8e162fd4ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.278962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c41e-1b2d-4c8a-ae80-d8e162fd4ea5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.280420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 90/184] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:25.286469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7984f-b356-4815-b2fc-b8cfb6ab07b1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.286847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7984f-b356-4815-b2fc-b8cfb6ab07b1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.287035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7984f-b356-4815-b2fc-b8cfb6ab07b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.305498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-37a7984f-b356-4815-b2fc-b8cfb6ab07b1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:25.306809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-37a7984f-b356-4815-b2fc-b8cfb6ab07b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:25.388523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 91/185] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:25.401933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef998b93-bec5-4eb0-9237-0a70161f10ea None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.402237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef998b93-bec5-4eb0-9237-0a70161f10ea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.402516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef998b93-bec5-4eb0-9237-0a70161f10ea None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.410850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 92/186] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:25.413142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.413461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.426426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb0af-73a4-4c88-b1b0-4fce2343615c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:25.432923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:25.434151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:25.478402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:25.480476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.480990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.481487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.482912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:25.483482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:25.486209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:25.503113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 95/187] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:25.504627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.516422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:25.523374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 93/188] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:25.524669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.564259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:25.646160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52bb5-be68-46eb-a32a-d25e6b33d4eb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:25.677596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b6e5-38d9-4939-a06f-37c055e25d66 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:25.692089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:25.692941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.693221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.693495 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.706243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:25.714594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:25.716294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:25.717882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 96/189] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:25.720313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.722732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:25.723634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.724146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.724146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] PATH_INFO: `/v3/users/500215c8aef54058bc1136810cef9452` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.741986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] RBAC: Authorizing `identity:get_user(user_id=500215c8aef54058bc1136810cef9452)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:25.744548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:25.747518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 94/190] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/users/500215c8aef54058bc1136810cef9452 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:25.748851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.822011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:25.870087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:25.880505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbc780-baa4-4d32-bd36-7a762ddd1941 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:25.883552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138e5a-b383-4eb5-96d5-eab05e548f1a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:25.927844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:25.928968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.929482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.929979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.931367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:25.931926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:25.932031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:25.933102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:25.933597 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:25.934091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:25.934526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:25.935770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:25.937620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:25.939555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 97/191] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:25.945298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:25.951052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 95/192] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:25.952422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:26.061832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f840a84-59e0-4ecd-a093-b7d12c130476 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:26.095280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386240-60df-4e17-934a-71450b8b4a8f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:26.117600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:26.118511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:26.118984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:26.119260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:26.126012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:26.145312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:26.146392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:26.146819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:26.147229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:26.148299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:26.150192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:26.158032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:26.202679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:26.204078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:26.273328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 96/193] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:25 2022] POST /identity/v3/users => generated 297 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:26.274932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:26.350332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 98/194] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:26.358079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:26.483196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613530-db9a-4942-9e43-6e16537ff99a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:26.501174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:26.546020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:26.548244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:26.549036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:26.549773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] PATH_INFO: `/v3/users/500215c8aef54058bc1136810cef9452` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:26.553229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] RBAC: Authorizing `identity:get_user(user_id=500215c8aef54058bc1136810cef9452)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:26.555234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:26.558032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 97/195] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:26 2022] GET /identity/v3/users/500215c8aef54058bc1136810cef9452 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:26.562483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f1ec2-3a49-49ea-9931-f722336ed98d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:26.566933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:26.627419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:26.634048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:26.635487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:26.635945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:26.636649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:26.638604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:26.641245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:26.645854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:26 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:26.656153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:26.751475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cd32-57ed-41ae-abd2-02265f1d310c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:26.819360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:26.820874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:26.821574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:26.822257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:26.852682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8f9a1-9832-409a-b968-4339d60df82f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:26.929182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:26.934227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:26.936152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:26.936973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:26.938763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:26.941097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=500215c8aef54058bc1136810cef9452) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:26.941879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:26.946200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:26.958005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 100/197] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:26 2022] GET /identity/v3/role_assignments?user.id=500215c8aef54058bc1136810cef9452&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:26.991290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:26.994210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:27.075093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:27.156844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 98/198] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:14:27.165968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:27.353402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaa4e8-d109-42dc-bb4f-cefbc8d346ad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:27.412194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096f61-0ac2-4737-abbc-d85743525dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:27.413138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f61-0ac2-4737-abbc-d85743525dca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:27.413426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f61-0ac2-4737-abbc-d85743525dca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:27.413707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f61-0ac2-4737-abbc-d85743525dca None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:27.415124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096f61-0ac2-4737-abbc-d85743525dca None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:27.416648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096f61-0ac2-4737-abbc-d85743525dca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:27.418789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 101/199] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:27 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:27.428459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:27.589581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7bb6-879e-47b0-97f7-8ba1be198012 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:27.640537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:27.641113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:27.641396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:27.641671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:27.642514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] RBAC: Adding query filter params (role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=500215c8aef54058bc1136810cef9452) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:27.642831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:27.644370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91d8c-0e2c-4fa2-bf96-f1f914a7ad56 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:27.656488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 99/200] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:27 2022] GET /identity/v3/role_assignments?user.id=500215c8aef54058bc1136810cef9452&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:27.850429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8bd1-83a8-44bb-a5a6-e70165cd9b8e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:27.851229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8bd1-83a8-44bb-a5a6-e70165cd9b8e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:27.851229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8bd1-83a8-44bb-a5a6-e70165cd9b8e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:27.852423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 102/201] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:27.860407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:27.860827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:27.860977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:27.886495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:27.887784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:27.900452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:28.067255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 100/202] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:28.113520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a8bd1-83a8-44bb-a5a6-e70165cd9b8e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:28.195675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:28.250029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a8bd1-83a8-44bb-a5a6-e70165cd9b8e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:28.307499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:28.308652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:28.309116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:28.309566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:28.324437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:28.333447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:28.334373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:28.335194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:28.337450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 103/203] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:28.346177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:28.469668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca047-ea53-43ed-819a-23030fe3c978 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:28.519954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:28.520933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:28.521360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:28.521779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:28.522704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:28.523245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:28.524980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:28.537668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:28.542211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 101/204] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:28.551480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:28.686734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638d77a-0b0c-4f26-9a90-f5ee473fb492 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:28.743679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:28.772704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:28.774282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:28.774784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:28.775275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] PATH_INFO: `/v3/users/f88a073696cb40088235a150006ceb69` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:28.781848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] RBAC: Authorizing `identity:get_user(user_id=f88a073696cb40088235a150006ceb69)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:28.784720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:28.788308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 104/205] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:28 2022] GET /identity/v3/users/f88a073696cb40088235a150006ceb69 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:28.797389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:29.064908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a90a1-fbd4-4254-bc80-6a51ec92d99c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:29.134761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:29.135894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:29.136417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:29.136907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:29.308376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:29.314140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:29.317622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:29.568219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 102/206] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:29.577118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:29.772970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f341b-2b8f-4d05-8e86-6e1d67e90fba None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:29.834463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9c8f-3447-40ef-b63d-57d81a5f3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:29.835830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9c8f-3447-40ef-b63d-57d81a5f3b74 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:29.836402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9c8f-3447-40ef-b63d-57d81a5f3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:29.836910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9c8f-3447-40ef-b63d-57d81a5f3b74 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:29.841345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9c8f-3447-40ef-b63d-57d81a5f3b74 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:29.843258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9c8f-3447-40ef-b63d-57d81a5f3b74 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:29.845776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 105/207] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:29 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:29.855799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:30.072230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:30.077421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4c7a-c11c-448b-9056-169f1b46dc1f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:30.077693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4c7a-c11c-448b-9056-169f1b46dc1f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:30.077826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f92db9-9d10-42a2-8d6b-41b12060bd2a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:30.077960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4c7a-c11c-448b-9056-169f1b46dc1f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:30.079694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 106/208] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:30.090153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:30.090153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:30.090153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:30.124853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:30.127662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:30.178049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:30.179215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:30.179712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:30.180207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:30.181904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] RBAC: Adding query filter params (role.id=eb2759eb02bc4973bf7af21b8c09d305, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72, user.id=f88a073696cb40088235a150006ceb69) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:30.182452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:30.187502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:30.212696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 103/209] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:29 2022] GET /identity/v3/role_assignments?user.id=f88a073696cb40088235a150006ceb69&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=eb2759eb02bc4973bf7af21b8c09d305 => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:30.281260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:30.308385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 107/210] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:30.345431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:30.555694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc990e9-3060-4980-be67-28bcd924d6c7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:30.630220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:30.631564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:30.632053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:30.632629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:30.654433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:30.670800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:30.672024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:30.672867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:30.674030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 104/211] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:30.681516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:30.902313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af391d-c613-4c23-9fc3-f3bab6480bb8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:30.983618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:30.984822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:30.985433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:30.985926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:30.987504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:30.988090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:30.991022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c70e-cc5d-4538-b720-5e3fcd41968e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:31.009897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 108/212] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:31.020100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:31.076092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:31.143464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f998-7145-46fe-9798-1670e7bef6a7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.144139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f998-7145-46fe-9798-1670e7bef6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.144715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f998-7145-46fe-9798-1670e7bef6a7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.146333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 109/213] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:31.152159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba93a6-0ea4-460b-ac44-b0b17663ffd3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.152854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba93a6-0ea4-460b-ac44-b0b17663ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.153341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba93a6-0ea4-460b-ac44-b0b17663ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.173738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-61ba93a6-0ea4-460b-ac44-b0b17663ffd3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:31.174965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949099-4e3f-4dda-991f-333a2d1655b0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:31.176162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-61ba93a6-0ea4-460b-ac44-b0b17663ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:31.224316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:31.225269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.225552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.225832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] PATH_INFO: `/v3/users/4207160b4ab04d7aab4bc5ead1a976ad` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.246097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] RBAC: Authorizing `identity:get_user(user_id=4207160b4ab04d7aab4bc5ead1a976ad)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:31.247797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:31.256366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 105/214] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:31 2022] GET /identity/v3/users/4207160b4ab04d7aab4bc5ead1a976ad => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:31.259447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:31.263027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:31.311666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 110/215] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:31.327741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568ed2-9128-4031-ba4c-b4ef340cb159 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.328259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568ed2-9128-4031-ba4c-b4ef340cb159 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.328799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568ed2-9128-4031-ba4c-b4ef340cb159 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.334513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 111/216] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:31.339879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.340716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.341205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.360490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:31.368197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:31.369501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:31.394544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e9929-ea99-4e04-8b9d-3bae150c6a24 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:31.447881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:31.448484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.448771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.449046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.487730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 112/217] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:31.487730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:31.532870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:31.534395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:31.653345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17273-2dc0-4cc4-914f-c8f8b53929a7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:31.679497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:31.685735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:31.713947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 106/218] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:14:31.719468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:31.722267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:31.723736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.725924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.725924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.745564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:31.761854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:31.763016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:31.764015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:31.765057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 113/219] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:31.766055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:31.870060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c7ebd-d043-4fc7-ad7b-213a4e5cdc66 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:31.913104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19014d59-fe08-4658-91cd-29812a092f4b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:31.931114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:31.932624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.933131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.933614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.935630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:31.938594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:31.942310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 107/220] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:31.943728 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:31.953439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9271d-161b-4906-94a5-4830ef4589ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:31.954395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9271d-161b-4906-94a5-4830ef4589ff None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.954739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9271d-161b-4906-94a5-4830ef4589ff None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.955074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9271d-161b-4906-94a5-4830ef4589ff None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.956472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9271d-161b-4906-94a5-4830ef4589ff None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:31.959008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9271d-161b-4906-94a5-4830ef4589ff None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:31.961214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 114/221] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:31 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:31.962175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456df4e-080b-4bf9-a1b6-2db6cfd9d0e3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:31.962563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456df4e-080b-4bf9-a1b6-2db6cfd9d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:31.962846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456df4e-080b-4bf9-a1b6-2db6cfd9d0e3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:31.964462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 115/222] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:31.965079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456df4e-080b-4bf9-a1b6-2db6cfd9d0e3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.011418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:32.027409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:32.067470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca55f17-8b47-4135-b9a9-52520f55e405 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:32.091511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456df4e-080b-4bf9-a1b6-2db6cfd9d0e3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:32.103986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:32.104715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.104999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.105260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.106034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:32.106341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:32.107771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:32.116807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 108/223] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:32.117677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.134053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f254b5-df63-42f7-a2c8-055318fd05ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:32.134739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f254b5-df63-42f7-a2c8-055318fd05ba None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.135063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f254b5-df63-42f7-a2c8-055318fd05ba None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.135378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f254b5-df63-42f7-a2c8-055318fd05ba None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.136106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f254b5-df63-42f7-a2c8-055318fd05ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:32.137641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f254b5-df63-42f7-a2c8-055318fd05ba None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:32.220719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17da55-245a-4cd3-9e54-5a75a12cc67b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:32.235117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:32.239115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 116/224] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:31 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:32.245442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.245442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.245442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.273104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:32.274342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:32.275654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:32.276938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.277385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.277822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.279220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=4207160b4ab04d7aab4bc5ead1a976ad) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:32.279700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:32.282440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:32.292196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 109/225] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:32 2022] GET /identity/v3/role_assignments?user.id=4207160b4ab04d7aab4bc5ead1a976ad&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=d132772f9a6144b996dae740722fe305 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:32.292969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.388018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 117/226] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:32.429605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.481339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:32.516701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bfd6-da86-40d3-83de-e04917303039 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:32.591001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:32.591908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.592427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.592675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] PATH_INFO: `/v3/users/500215c8aef54058bc1136810cef9452` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.594557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] RBAC: Authorizing `identity:get_user(user_id=500215c8aef54058bc1136810cef9452)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:32.596096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:32.599000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 110/227] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:32 2022] GET /identity/v3/users/500215c8aef54058bc1136810cef9452 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:32.604729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.606876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcd4a1-11ef-49d2-ba3a-226d2b8b68f8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:32.667038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:32.667247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.667492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.667683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.687509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:32.694274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:32.698450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:32.699394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:32.700193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:32.701095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 118/228] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:32.709802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.809892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05037-a5db-47c3-957e-9e6ce81a6d24 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:32.907951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:32.909522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:32.910059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:32.910565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:32.916806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:32.919432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:32.922857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 111/229] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:32 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:32.932372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:32.935716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:32.953091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c6b54-5821-41ac-8746-8dde9950487a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:33.080292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:33.081956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:33.082690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:33.083429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:33.085192 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:33.086025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:33.090057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:33.108275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 119/230] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:33.118733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:33.238540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816233df-9f6e-49e9-8849-5b2f5713e623 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:33.263784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:33.326243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90543793-1b5d-4bcc-b2df-0f7d676c0c78 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:33.333375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:33.334229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:33.334570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:33.334855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/500215c8aef54058bc1136810cef9452/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:33.342682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] RBAC: Authorizing `identity:create_grant(project_id=26263b5d1bd4408382b3e5e48f9f5268, user_id=500215c8aef54058bc1136810cef9452, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:33.344184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:33.380821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:33.381725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:33.382010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:33.382342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] PATH_INFO: `/v3/users/500215c8aef54058bc1136810cef9452` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:33.383823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] RBAC: Authorizing `identity:get_user(user_id=500215c8aef54058bc1136810cef9452)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:33.385404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:33.387639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 120/231] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:33 2022] GET /identity/v3/users/500215c8aef54058bc1136810cef9452 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:33.396543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:33.436161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:33.478343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 112/232] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:32 2022] PUT /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/500215c8aef54058bc1136810cef9452/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:33.608801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2c252-8ca7-468b-b78d-6246981f30e1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:33.689875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae68c42-c02b-489e-ba8a-d2c108b0c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:33.691371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68c42-c02b-489e-ba8a-d2c108b0c79d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:33.691847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68c42-c02b-489e-ba8a-d2c108b0c79d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:33.692313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68c42-c02b-489e-ba8a-d2c108b0c79d None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:33.694530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae68c42-c02b-489e-ba8a-d2c108b0c79d None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:33.697184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae68c42-c02b-489e-ba8a-d2c108b0c79d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:33.700958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 121/233] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:33 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:33.710709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:33.913319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a7670-9fc5-4223-9b18-f7378f29a335 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:33.984921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580259d3-7a72-4896-8a6a-ca5df86116be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:33.986855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580259d3-7a72-4896-8a6a-ca5df86116be None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:33.987779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580259d3-7a72-4896-8a6a-ca5df86116be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:33.988313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580259d3-7a72-4896-8a6a-ca5df86116be None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/500215c8aef54058bc1136810cef9452/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:33.992626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580259d3-7a72-4896-8a6a-ca5df86116be None admin] RBAC: Authorizing `identity:create_grant(project_id=26263b5d1bd4408382b3e5e48f9f5268, user_id=500215c8aef54058bc1136810cef9452, role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:33.995532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580259d3-7a72-4896-8a6a-ca5df86116be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:34.112185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 113/234] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:33 2022] PUT /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/500215c8aef54058bc1136810cef9452/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:35.242089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082af8-8866-4c94-9fad-7877b8786484 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:35.242824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082af8-8866-4c94-9fad-7877b8786484 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:35.244086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082af8-8866-4c94-9fad-7877b8786484 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:35.246825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 122/235] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:35.262159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:35.262838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:35.263176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:35.305781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:35.307847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:35.383356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:35.488589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 114/236] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:35.543531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082af8-8866-4c94-9fad-7877b8786484 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:35.658791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:35.685189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082af8-8866-4c94-9fad-7877b8786484 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:35.738077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:35.740069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:35.740531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:35.741042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:35.769977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:35.789908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:35.791768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:35.793456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 123/237] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:35.804020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:36.125126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644f655-9f74-4a25-8f18-025a3bdeab14 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:36.213983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:36.215666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:36.216501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:36.217307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:36.219075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:36.219904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:36.222772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:36.249046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 115/238] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:36.257865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:36.495610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65da3d-8df3-45ac-8bc2-286d49463429 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:36.581096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:36.582903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:36.583414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:36.583923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] PATH_INFO: `/v3/users/4207160b4ab04d7aab4bc5ead1a976ad` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:36.589444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] RBAC: Authorizing `identity:get_user(user_id=4207160b4ab04d7aab4bc5ead1a976ad)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:36.590989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:36.593116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 124/239] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:36 2022] GET /identity/v3/users/4207160b4ab04d7aab4bc5ead1a976ad => generated 297 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:36.602302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:36.696973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:36.872939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80192f-399a-4cbb-b14d-5dacbcbb2fb3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:36.944540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a21ef-34be-4f13-815f-d5196263dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:36.946160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a21ef-34be-4f13-815f-d5196263dc0a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:36.947942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a21ef-34be-4f13-815f-d5196263dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:36.948508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a21ef-34be-4f13-815f-d5196263dc0a None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:36.952228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a21ef-34be-4f13-815f-d5196263dc0a None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:36.955047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a21ef-34be-4f13-815f-d5196263dc0a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:36.958760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 116/240] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:36 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:36.969489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:36.980686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c990f0e-2f04-49b1-8248-85114214cf14 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:36.981527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c990f0e-2f04-49b1-8248-85114214cf14 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:36.982242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c990f0e-2f04-49b1-8248-85114214cf14 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:36.985639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 117/241] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:36.995263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef702-d04d-48ed-a392-802a9b39e518 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:36.996074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef702-d04d-48ed-a392-802a9b39e518 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:36.997125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef702-d04d-48ed-a392-802a9b39e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:36.999048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:37.029658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-332ef702-d04d-48ed-a392-802a9b39e518 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:37.032577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-332ef702-d04d-48ed-a392-802a9b39e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:37.161623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e01795-e145-40f5-9222-297f5fd007ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:37.188727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 118/242] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:37.192515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c961-0c28-420e-852c-f1f552bf9e4f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.193423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c961-0c28-420e-852c-f1f552bf9e4f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.194309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c961-0c28-420e-852c-f1f552bf9e4f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.205945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 119/243] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:37.216708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.217343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.217915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.251609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:37.251913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:37.254543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.254782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:37.255413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.256119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/4207160b4ab04d7aab4bc5ead1a976ad/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.260172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] RBAC: Authorizing `identity:create_grant(project_id=26263b5d1bd4408382b3e5e48f9f5268, user_id=4207160b4ab04d7aab4bc5ead1a976ad, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:37.263436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:37.295029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:37.346937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 125/244] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:36 2022] PUT /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/4207160b4ab04d7aab4bc5ead1a976ad/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:37.349693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:37.426942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 120/245] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:37.477431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:37.542279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:37.632262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737601a5-9c50-4756-9f0e-697029beffef None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:37.697003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9203d0a-6482-464f-9992-38d0b34ea7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:37.698229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9203d0a-6482-464f-9992-38d0b34ea7cd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.698964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9203d0a-6482-464f-9992-38d0b34ea7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.699685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9203d0a-6482-464f-9992-38d0b34ea7cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.717279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf288250-b5bc-46f2-8dfc-8d29f9d56e43 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:37.723064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9203d0a-6482-464f-9992-38d0b34ea7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f9203d0a-6482-464f-9992-38d0b34ea7cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:37.740012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:37.743342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:37.745307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:37.747748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 126/246] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:37.754578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ebf84-c761-40aa-bf2a-4ad07bfebd39 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.755306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ebf84-c761-40aa-bf2a-4ad07bfebd39 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.755924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ebf84-c761-40aa-bf2a-4ad07bfebd39 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.763193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 127/247] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:37 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:37.764949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ebf84-c761-40aa-bf2a-4ad07bfebd39 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:37.803336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b84f4-1d41-410e-a006-5bdaec14874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:37.805195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b84f4-1d41-410e-a006-5bdaec14874f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.806017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b84f4-1d41-410e-a006-5bdaec14874f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.806790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b84f4-1d41-410e-a006-5bdaec14874f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.809638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b84f4-1d41-410e-a006-5bdaec14874f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:37.813054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b84f4-1d41-410e-a006-5bdaec14874f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:37.817792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 121/248] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:37.823282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:37.823282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:37.823282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:37.853665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:37.856469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:37.899528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:37.925201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ebf84-c761-40aa-bf2a-4ad07bfebd39 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:38.009950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:38.018488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 122/249] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:38.027350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:38.027350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.027741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:38.027887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.027887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.027887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:38.027887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:38.027887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:38.042095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 128/250] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:38.051242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:38.181391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d49292-89bf-44e0-b826-8e0dbf0798c6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:38.216681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9687-ea80-4810-8d1d-a1707a4e399a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:38.219189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1db329-b9c8-467c-83db-4d6622e29a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:38.219919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db329-b9c8-467c-83db-4d6622e29a9f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.220263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db329-b9c8-467c-83db-4d6622e29a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.220601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db329-b9c8-467c-83db-4d6622e29a9f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.221357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1db329-b9c8-467c-83db-4d6622e29a9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:38.223442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1db329-b9c8-467c-83db-4d6622e29a9f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:38.273635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:38.274478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.274763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.275077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] PATH_INFO: `/v3/users/5c35840e382d4a0cbf0bf459d961eb80` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.292600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] RBAC: Authorizing `identity:get_user(user_id=5c35840e382d4a0cbf0bf459d961eb80)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:38.294329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:38.296563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 129/251] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:38 2022] GET /identity/v3/users/5c35840e382d4a0cbf0bf459d961eb80 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:38.297545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:38.308470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 123/252] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:38 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:38.308470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e81d5d-6c34-49df-90f8-fb2c9cb95f52 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.308470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e81d5d-6c34-49df-90f8-fb2c9cb95f52 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.308470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e81d5d-6c34-49df-90f8-fb2c9cb95f52 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.308470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 124/253] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:38.308470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e81d5d-6c34-49df-90f8-fb2c9cb95f52 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:38.326788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:38.445886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:38.545091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e81d5d-6c34-49df-90f8-fb2c9cb95f52 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:38.545782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb21f3-7ab3-4fcd-b0ae-896abd2664a1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:38.611856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:38.613214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.613843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.614411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.635672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a083f0-4825-43f8-ad0f-6c22164a0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:38.635672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a083f0-4825-43f8-ad0f-6c22164a0e11 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.635672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a083f0-4825-43f8-ad0f-6c22164a0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.635672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a083f0-4825-43f8-ad0f-6c22164a0e11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.655825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a083f0-4825-43f8-ad0f-6c22164a0e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-59a083f0-4825-43f8-ad0f-6c22164a0e11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:38.673827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:38.675855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:38.677749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:38.680153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 130/254] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:38.684130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:38.684130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:38.684695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:38.706316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:38.708121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:38.773555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:38.775158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:38.786581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:38.847827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 131/255] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:38.849311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:38.935005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:38.973292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 125/256] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:38.975036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:39.079562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4a82d-830e-4c09-b0da-5e9a60bebecb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:39.156734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:39.157799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:39.158288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:39.158757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:39.160728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:39.161269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:39.163659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:39.204811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 132/257] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:39.206150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:39.294588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a63b4f-7081-429a-9dd5-290e88d535b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:39.328912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:39.432557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:39.433786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:39.434251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:39.434707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:39.481988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:39.497352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:39.498340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:39.499163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:39.504130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a65657-164d-4fd5-a5b3-ee68a8acf110 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:39.504815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 126/258] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:39.506000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:39.506181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:39.576308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:39.578036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:39.578522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:39.579093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:39.581507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:39.584408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:39.588188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 133/259] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:39 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:39.589685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:39.646247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ad08b-2c3f-4235-87fc-1af31a289d95 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:39.688059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:39.689333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:39.689908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:39.690391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] PATH_INFO: `/v3/users/500215c8aef54058bc1136810cef9452` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:39.692101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] RBAC: Authorizing `identity:get_user(user_id=500215c8aef54058bc1136810cef9452)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:39.693904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:39.696346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 127/260] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:39 2022] GET /identity/v3/users/500215c8aef54058bc1136810cef9452 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:39.697504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:39.797184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:39.826814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c75f-728a-41a5-b93c-891dce6be209 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:39.865389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:39.866432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:39.866940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:39.867430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:39.868585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] RBAC: Adding query filter params (role.id=eb2759eb02bc4973bf7af21b8c09d305, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=5c35840e382d4a0cbf0bf459d961eb80) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:39.869123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:39.870806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:39.877335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 128/261] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:39 2022] GET /identity/v3/role_assignments?user.id=5c35840e382d4a0cbf0bf459d961eb80&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=eb2759eb02bc4973bf7af21b8c09d305 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:39.878654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:39.890009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190bb0-7e60-4096-8a24-1ae012f219a9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:39.970744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:39.971818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:39.972382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:39.973351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:39.974737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:39.975270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:39.986115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:40.010921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 134/262] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:40.020276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:40.056855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d39e2a-b2d0-4d02-b3af-7582b01cc226 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:40.060630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:40.148573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:40.175350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:40.177091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:40.177541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:40.180976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:40.356189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99daa0-986a-4750-b634-ffcf8ec510bb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:40.421111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:40.424102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:40.514834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:40.516352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:40.516846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:40.517329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] PATH_INFO: `/v3/users/500215c8aef54058bc1136810cef9452` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:40.525483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] RBAC: Authorizing `identity:get_user(user_id=500215c8aef54058bc1136810cef9452)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:40.527098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:40.530364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 135/263] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:40 2022] GET /identity/v3/users/500215c8aef54058bc1136810cef9452 => generated 283 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:40.540100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:40.708897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:40.719549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 129/264] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:40.727236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:40.811744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c329c5-6b1d-40da-8ce9-bd758c19a1cf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:40.821074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:40.881830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1abc9-4bae-4427-943b-c51a54b2fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:40.882566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1abc9-4bae-4427-943b-c51a54b2fef6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:40.882866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1abc9-4bae-4427-943b-c51a54b2fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:40.883112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1abc9-4bae-4427-943b-c51a54b2fef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:40.994408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1abc9-4bae-4427-943b-c51a54b2fef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:41.001689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1abc9-4bae-4427-943b-c51a54b2fef6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:41.047701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd36f0-bd7e-4601-86a4-2a0758ffed43 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:41.120391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 136/265] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:14:41.121819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18290e49-c22e-4959-81c6-05a4a7e4317b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.122112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18290e49-c22e-4959-81c6-05a4a7e4317b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.122381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18290e49-c22e-4959-81c6-05a4a7e4317b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.123818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 137/266] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:41.125144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18290e49-c22e-4959-81c6-05a4a7e4317b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:41.144041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:41.186116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf908a9-eefd-43c2-9cce-9d5d3d983cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:41.187649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf908a9-eefd-43c2-9cce-9d5d3d983cbc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.188152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf908a9-eefd-43c2-9cce-9d5d3d983cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.188690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf908a9-eefd-43c2-9cce-9d5d3d983cbc None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.197979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf908a9-eefd-43c2-9cce-9d5d3d983cbc None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:41.201228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf908a9-eefd-43c2-9cce-9d5d3d983cbc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:41.212484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 130/267] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:40 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:41.214933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.215424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.215912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.243694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18290e49-c22e-4959-81c6-05a4a7e4317b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:41.275754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:41.277093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:41.312937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:41.312937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.312937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.312937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.313316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:41.313316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:41.319324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 138/268] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:41 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:41.320536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:41.428823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:41.450578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:41.464558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa808e-3fac-4ac7-bb9b-d52a514c8863 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:41.483300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 131/269] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:41.484913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:41.504924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:41.505616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.505901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.506180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.507023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=500215c8aef54058bc1136810cef9452) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:41.507342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:41.508941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:41.516838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 139/270] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:41 2022] GET /identity/v3/role_assignments?user.id=500215c8aef54058bc1136810cef9452&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:41.547881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:41.705027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94cdb5-b09f-4e44-ac5e-b6880d833b4c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:41.748502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:41.749352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.749688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.749969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.760749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:41.768544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:41.787592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:41.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:41.789423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 140/271] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:41.806076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:41.864347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbca7-1f91-4785-83dc-b40ba0f079a7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:41.944207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:41.946753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:41.947034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:41.947309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:41.948181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] RBAC: Adding query filter params (role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=500215c8aef54058bc1136810cef9452) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:41.953613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:41.955229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:41.974010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 132/272] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:41 2022] GET /identity/v3/role_assignments?user.id=500215c8aef54058bc1136810cef9452&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 608 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:42.037289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be934ad8-0c1e-40c3-9126-14aa26a73060 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:42.094158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:42.094861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:42.095143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:42.095418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:42.096196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:42.096530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:42.098602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:42.111931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 141/273] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:42.121597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:42.244967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:42.298284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca6b4-f44f-4b34-be28-a5034cdf3937 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:42.343493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abe018-d7c8-4c64-be84-03defc56569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:42.344422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abe018-d7c8-4c64-be84-03defc56569f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:42.344759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abe018-d7c8-4c64-be84-03defc56569f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:42.345040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abe018-d7c8-4c64-be84-03defc56569f None admin] PATH_INFO: `/v3/users/4207160b4ab04d7aab4bc5ead1a976ad` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:42.346378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abe018-d7c8-4c64-be84-03defc56569f None admin] RBAC: Authorizing `identity:get_user(user_id=4207160b4ab04d7aab4bc5ead1a976ad)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:42.347920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abe018-d7c8-4c64-be84-03defc56569f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:42.349724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 133/274] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:42 2022] GET /identity/v3/users/4207160b4ab04d7aab4bc5ead1a976ad => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:42.355603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:42.424959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:42.479243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f455b4-554f-4835-84bd-10b24bf8cb77 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:42.522178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:42.522932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:42.523119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:42.523403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:42.601271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:42.602831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:42.667312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:42.716069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca97256-1998-4268-b110-6d698a477885 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:42.716374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca97256-1998-4268-b110-6d698a477885 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:42.716935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca97256-1998-4268-b110-6d698a477885 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:42.719787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 134/275] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:42.721908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 142/276] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:42.727690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:42.727977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:42.728490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:42.730044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:42.750989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:42.752796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:42.860787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 135/277] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:42.873863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920eaae-a8d9-47aa-9979-5dd36caf3159 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:42.883595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:42.913281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:42.914221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:42.914547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:42.914825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:42.916252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:42.917828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:42.919723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 143/278] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:42 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:42.927161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:42.956267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:42.958326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:43.004239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec837-0e29-48b5-8a8e-e45a3b960a03 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.042272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e0baf-63a4-4ae9-9f22-d14eb5902ca6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.044373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce115ba8-0a24-4a63-902a-bb85ff21771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.045198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115ba8-0a24-4a63-902a-bb85ff21771a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.045468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115ba8-0a24-4a63-902a-bb85ff21771a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.045741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115ba8-0a24-4a63-902a-bb85ff21771a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.058364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce115ba8-0a24-4a63-902a-bb85ff21771a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ce115ba8-0a24-4a63-902a-bb85ff21771a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:43.067401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:43.068356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:43.069180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 136/279] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:43.074752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867081-86da-4a1f-bd01-30f471fb55fe None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.075041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867081-86da-4a1f-bd01-30f471fb55fe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.075351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867081-86da-4a1f-bd01-30f471fb55fe None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.077026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 137/280] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:43.077760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32867081-86da-4a1f-bd01-30f471fb55fe None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:43.086508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.087448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.087927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.088407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.089253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=4207160b4ab04d7aab4bc5ead1a976ad) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:43.089564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:43.091040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18781f3e-f5b7-4003-9fd1-ebf30c5b19ae None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:43.104650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 144/281] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:42 2022] GET /identity/v3/role_assignments?user.id=4207160b4ab04d7aab4bc5ead1a976ad&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=d132772f9a6144b996dae740722fe305 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:43.104650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.104650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.104650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.125675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:43.127534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:43.213289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32867081-86da-4a1f-bd01-30f471fb55fe None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.236448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 145/282] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:43.240034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:43.261649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:43.265688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.266693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.267157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.267680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.268697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:43.269343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:43.272065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:43.283544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:43.285599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 138/283] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:43.291667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:43.413867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707df090-59c5-4622-a2b2-ba78a0da027a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.459779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.461335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.461335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.461335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.462623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:43.464345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:43.466313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 146/284] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:43.467930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c1de7-159b-45b7-be72-7ae4fbf2066f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.472492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:43.517448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.518748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.518748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.518923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] PATH_INFO: `/v3/users/f7b27651c3694603a41ee68ecfe6bec1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.534218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] RBAC: Authorizing `identity:get_user(user_id=f7b27651c3694603a41ee68ecfe6bec1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:43.535667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:43.537686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 139/285] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:43 2022] GET /identity/v3/users/f7b27651c3694603a41ee68ecfe6bec1 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:43.543182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:43.593528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:43.603929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:43.623527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af926c14-d23e-4bfb-b825-8cd02f7e08ed None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.664014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a824b64-f3c5-4e6b-9014-3136a07da08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.664637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a824b64-f3c5-4e6b-9014-3136a07da08d None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.664920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a824b64-f3c5-4e6b-9014-3136a07da08d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.665196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a824b64-f3c5-4e6b-9014-3136a07da08d None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.665936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a824b64-f3c5-4e6b-9014-3136a07da08d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:43.667434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a824b64-f3c5-4e6b-9014-3136a07da08d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:43.703079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ead4d-564e-4aa3-ae7e-66d75e14c52b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:43.747831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:43.748542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.748828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.749163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.749947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, user.id=f7b27651c3694603a41ee68ecfe6bec1, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:43.750263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:43.751719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c6672-15c5-4545-8715-94bfc73a5921 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:43.758189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 140/286] 10.222.0.67 () {56 vars in 1308 bytes} [Fri May 27 09:14:43 2022] GET /identity/v3/role_assignments?user.id=f7b27651c3694603a41ee68ecfe6bec1&scope.system=all&role.id=d132772f9a6144b996dae740722fe305 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:43.769758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 147/287] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:14:43 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:14:43.986444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51efe-d6f3-4d84-bebf-574e54249cd0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:43.986864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51efe-d6f3-4d84-bebf-574e54249cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:43.987364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51efe-d6f3-4d84-bebf-574e54249cd0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:43.990630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 141/288] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:43.999788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:44.000289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:44.000850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:44.028867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:44.031104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:44.151581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 148/289] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:44.174986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc51efe-d6f3-4d84-bebf-574e54249cd0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:44.298342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc51efe-d6f3-4d84-bebf-574e54249cd0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:44.300067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:44.346887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:44.348900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:44.349404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:44.349900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:44.370388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:44.386968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:44.388734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:44.391287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 142/290] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:44.399057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:44.537724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:44.585217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d005d7-6c49-4b7b-b2a8-fb19ac61a08d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:44.624651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:44.625614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:44.625614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:44.626090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:44.626654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:44.626960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:44.628445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:44.641041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 149/291] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:44.650499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:44.843674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8b58b-2395-4b47-a2c5-9a3ba2475441 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:44.883671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:44.884598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:44.884869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:44.885147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] PATH_INFO: `/v3/users/5c35840e382d4a0cbf0bf459d961eb80` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:44.886434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] RBAC: Authorizing `identity:get_user(user_id=5c35840e382d4a0cbf0bf459d961eb80)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:44.887886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:44.889583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 143/292] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:44 2022] GET /identity/v3/users/5c35840e382d4a0cbf0bf459d961eb80 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:44.898042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:45.096668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b659d7-aa2a-4e37-a006-8401ab9edf85 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:45.159091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23256aa-0766-45e7-8ba3-2fa9cb107e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:45.161657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23256aa-0766-45e7-8ba3-2fa9cb107e43 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:45.162459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23256aa-0766-45e7-8ba3-2fa9cb107e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:45.163238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23256aa-0766-45e7-8ba3-2fa9cb107e43 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:45.165880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23256aa-0766-45e7-8ba3-2fa9cb107e43 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:45.168997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23256aa-0766-45e7-8ba3-2fa9cb107e43 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:45.173107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 150/293] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:44 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:45.185418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:45.220082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:45.298430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc90d95-a890-444b-8e62-5e0a3dafdf5f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:45.340686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e61bd-62d7-49b1-acfd-6c792c69dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:45.341622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e61bd-62d7-49b1-acfd-6c792c69dd58 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:45.341904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e61bd-62d7-49b1-acfd-6c792c69dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:45.342180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e61bd-62d7-49b1-acfd-6c792c69dd58 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/5c35840e382d4a0cbf0bf459d961eb80/roles/eb2759eb02bc4973bf7af21b8c09d305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:45.344454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e61bd-62d7-49b1-acfd-6c792c69dd58 None admin] RBAC: Authorizing `identity:create_grant(project_id=26263b5d1bd4408382b3e5e48f9f5268, user_id=5c35840e382d4a0cbf0bf459d961eb80, role_id=eb2759eb02bc4973bf7af21b8c09d305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:45.345964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e61bd-62d7-49b1-acfd-6c792c69dd58 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:45.467741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 144/294] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:14:45 2022] PUT /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/users/5c35840e382d4a0cbf0bf459d961eb80/roles/eb2759eb02bc4973bf7af21b8c09d305 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:46.066941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1acf-e57e-4912-bca0-a9328f94a1ec None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.067469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1acf-e57e-4912-bca0-a9328f94a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.067469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1acf-e57e-4912-bca0-a9328f94a1ec None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.068955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 151/295] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:46.074892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.075329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.075716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.094847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:46.096082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:46.179252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 145/296] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:46.201704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1acf-e57e-4912-bca0-a9328f94a1ec None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:46.204764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:46.395169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1acf-e57e-4912-bca0-a9328f94a1ec None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:46.466160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103e32c-107a-40e5-bc2f-030324e85bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:46.467550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e32c-107a-40e5-bc2f-030324e85bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.468012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e32c-107a-40e5-bc2f-030324e85bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.468549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e32c-107a-40e5-bc2f-030324e85bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.489425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103e32c-107a-40e5-bc2f-030324e85bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6103e32c-107a-40e5-bc2f-030324e85bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:46.502836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:46.504415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:46.505216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:46.505813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 152/297] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:46.514205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:46.539517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:46.606288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c96581-964f-4472-9d19-59ca53721831 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.606659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c96581-964f-4472-9d19-59ca53721831 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.606900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c96581-964f-4472-9d19-59ca53721831 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.612590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 153/298] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:46.614552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.614848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.615130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.634462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:46.635719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:46.636286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59347cf-ac21-40e0-bc8c-d9f369b2e5c9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:46.687883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:46.688503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.689018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.689520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.690973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:46.692100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:46.694909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:46.715397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 146/299] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:46.725001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:46.729139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:46.766739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 154/300] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:46.791634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:46.894789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:46.915089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac76f0-fff0-4335-b14e-246b8274e213 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:46.932037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e1d9-783a-41ee-aa78-d23a95c4005d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:46.957873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58826de-6087-43f3-9211-2b28c322f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:46.958560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58826de-6087-43f3-9211-2b28c322f4bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:46.958842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58826de-6087-43f3-9211-2b28c322f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:46.959128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58826de-6087-43f3-9211-2b28c322f4bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:46.977335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58826de-6087-43f3-9211-2b28c322f4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c58826de-6087-43f3-9211-2b28c322f4bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:46.993131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:46.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:46.994914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:46.998783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 155/301] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:47.000003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394b205-4034-4c29-b1f6-285f10c2f46a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.000295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394b205-4034-4c29-b1f6-285f10c2f46a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.000609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394b205-4034-4c29-b1f6-285f10c2f46a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.002301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 156/302] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:47.007659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394b205-4034-4c29-b1f6-285f10c2f46a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:47.038447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791aaa-ac74-429a-a460-c5087810c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.039367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791aaa-ac74-429a-a460-c5087810c109 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.039644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791aaa-ac74-429a-a460-c5087810c109 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.039918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791aaa-ac74-429a-a460-c5087810c109 None admin] PATH_INFO: `/v3/users/f7b27651c3694603a41ee68ecfe6bec1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.041287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b791aaa-ac74-429a-a460-c5087810c109 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b27651c3694603a41ee68ecfe6bec1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.042924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b791aaa-ac74-429a-a460-c5087810c109 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.044770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 147/303] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:46 2022] GET /identity/v3/users/f7b27651c3694603a41ee68ecfe6bec1 => generated 293 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:47.050890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.051285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.051568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.072262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:47.073529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:47.075934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:47.155472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 148/304] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:47.157980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:47.173779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394b205-4034-4c29-b1f6-285f10c2f46a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:47.231224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.231224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.231224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.231224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.231807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:47.231807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.232609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.243813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 157/305] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:47.244733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:47.279984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:47.313829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5b8bd-a33c-44c4-8531-bb02911f9b11 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:47.367108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9ece-ca05-48a5-a6b5-3daf6cf87624 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:47.377549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.379592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.380093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.380617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] PATH_INFO: `/v3/system/users/f7b27651c3694603a41ee68ecfe6bec1/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.383366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f7b27651c3694603a41ee68ecfe6bec1, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.384383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:47.386082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.407023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.407903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.408185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.408507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.409805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.411416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.413120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 158/306] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:47.415626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:47.568946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 149/307] 10.222.0.67 () {58 vars in 1334 bytes} [Fri May 27 09:14:47 2022] PUT /identity/v3/system/users/f7b27651c3694603a41ee68ecfe6bec1/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:47.569877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:47.578339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9855b5-337b-4a41-b28e-cb45a28e7977 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:47.635074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.636472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.636982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.650718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] PATH_INFO: `/v3/users/c0ed43df8010430382146ad8c8c20250` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.655418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ed43df8010430382146ad8c8c20250)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.657456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.659689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 159/308] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:47 2022] GET /identity/v3/users/c0ed43df8010430382146ad8c8c20250 => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:47.670247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:47.754003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:47.755911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70baf0f-84a5-4122-86ee-acb3b55e2b34 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:47.799516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f17a-5d90-4801-828f-9c37f4fe8c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.801191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f17a-5d90-4801-828f-9c37f4fe8c03 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.801191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f17a-5d90-4801-828f-9c37f4fe8c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.801575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f17a-5d90-4801-828f-9c37f4fe8c03 None admin] PATH_INFO: `/v3/groups` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.802774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f17a-5d90-4801-828f-9c37f4fe8c03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.803910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f17a-5d90-4801-828f-9c37f4fe8c03 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.856544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f36d91-4442-4a53-8f81-4ce81d51dd76 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:47.885168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 150/309] 10.222.0.67 () {60 vars in 1134 bytes} [Fri May 27 09:14:47 2022] POST /identity/v3/groups => generated 229 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:14:47.902365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ca93-8c46-45da-bad4-b30027ab35c7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.903025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ca93-8c46-45da-bad4-b30027ab35c7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.903513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ca93-8c46-45da-bad4-b30027ab35c7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.905307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 151/310] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:47.911985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.912659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.913189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.922408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:47.928840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:47.930003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:47.931611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:47.932194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:47.934366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] RBAC: Adding query filter params (role.id=eb2759eb02bc4973bf7af21b8c09d305, user.id=c0ed43df8010430382146ad8c8c20250, scope.system=all) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:47.934909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:47.937776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:47.938877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:47.940514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:47.952201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 160/311] 10.222.0.67 () {56 vars in 1308 bytes} [Fri May 27 09:14:47 2022] GET /identity/v3/role_assignments?user.id=c0ed43df8010430382146ad8c8c20250&scope.system=all&role.id=eb2759eb02bc4973bf7af21b8c09d305 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:48.135417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 152/312] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:48.161561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:48.337380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b380-4968-43de-967e-a15048f2e230 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:48.341543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:48.399188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:48.400501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:48.401032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:48.401538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:48.421497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:48.437431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:48.438392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:48.439194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:48.440300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 161/313] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:48.446432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:48.555748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820fd63-f035-4262-808d-0ab3d056225e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:48.593677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:48.594436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:48.594635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:48.594909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:48.595675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:48.595983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:48.597472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:48.599162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:48.611706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 153/314] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:48.613498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:48.798412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a5ba-01ce-439f-a95f-a4baac100725 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:48.860503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:48.861999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:48.862494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:48.863015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] PATH_INFO: `/v3/users/5c35840e382d4a0cbf0bf459d961eb80` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:48.865084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5c35840e382d4a0cbf0bf459d961eb80)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:48.867676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:48.871176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 162/315] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:48 2022] GET /identity/v3/users/5c35840e382d4a0cbf0bf459d961eb80 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:48.876361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:48.988498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c6ad8-ec9b-443f-8f57-d78e620f53e5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:49.025622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:49.026284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:49.026570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:49.026843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:49.097324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:49.104462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:49.105949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:49.212836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 154/316] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:49.218442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:49.258781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:49.360924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8b27-8201-4945-bca9-efc4babad0d2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:49.422188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135617a-8a1c-4012-9814-6c929f1e2dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:49.423647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135617a-8a1c-4012-9814-6c929f1e2dcc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:49.424164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135617a-8a1c-4012-9814-6c929f1e2dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:49.424703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135617a-8a1c-4012-9814-6c929f1e2dcc None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:49.427518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135617a-8a1c-4012-9814-6c929f1e2dcc None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:49.430333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135617a-8a1c-4012-9814-6c929f1e2dcc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:49.434076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 163/317] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:49 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:49.439588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:49.542127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:49.548773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95057f0-4061-420b-a614-e56622f07758 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:49.586489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:49.587173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:49.587458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:49.587732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:49.588630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] RBAC: Adding query filter params (role.id=eb2759eb02bc4973bf7af21b8c09d305, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268, user.id=5c35840e382d4a0cbf0bf459d961eb80) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:49.588946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:49.590573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc0274-5e2c-4dde-9739-c983ea3045df None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:49.598290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 155/318] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:14:49 2022] GET /identity/v3/role_assignments?user.id=5c35840e382d4a0cbf0bf459d961eb80&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=eb2759eb02bc4973bf7af21b8c09d305 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:50.084430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91c95-314d-4720-aa8e-9e39ba3c0c0a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.084810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91c95-314d-4720-aa8e-9e39ba3c0c0a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.085005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91c95-314d-4720-aa8e-9e39ba3c0c0a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.086552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 164/319] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:50.091933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd20e4-1343-4a7a-91f0-1d3fee003c66 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.092266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd20e4-1343-4a7a-91f0-1d3fee003c66 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.092557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd20e4-1343-4a7a-91f0-1d3fee003c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.110096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-80fd20e4-1343-4a7a-91f0-1d3fee003c66 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:50.111310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-80fd20e4-1343-4a7a-91f0-1d3fee003c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:50.183562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 156/320] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:50.207513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91c95-314d-4720-aa8e-9e39ba3c0c0a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:50.217305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6b87-25bb-4b28-a254-c30c0955b858 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.217598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6b87-25bb-4b28-a254-c30c0955b858 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.217883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6b87-25bb-4b28-a254-c30c0955b858 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.219322 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 157/321] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:50.226034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.226319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.226759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.244870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:50.246104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:50.322910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 158/322] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:14:50.330399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:50.335591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91c95-314d-4720-aa8e-9e39ba3c0c0a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:50.345756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:50.367835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:50.375478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:50.376285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.376623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.376888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.388776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:50.397541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:50.398494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:50.399456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 165/323] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:50.404673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:50.462540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceb165-6b2a-4bb4-a0d7-8191bcbca52d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:50.500817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:50.501644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.501929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.502207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.503620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:50.505158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:50.508375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 159/324] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:50.512616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:50.518088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915323e-e048-42fd-999f-87d63bea5fa6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:50.558229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:50.558926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.559211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.559491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.560252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:50.560703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:50.562211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:50.572363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 166/325] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:50.577948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:50.608471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:50.612691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:50.625810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fc5ec-7926-4eb7-b4d5-cbebc590626a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:50.661914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f931-e880-44c0-b433-5d529a4e742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:50.662730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f931-e880-44c0-b433-5d529a4e742a None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.663004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f931-e880-44c0-b433-5d529a4e742a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.663276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f931-e880-44c0-b433-5d529a4e742a None admin] PATH_INFO: `/v3/groups` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.663982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f931-e880-44c0-b433-5d529a4e742a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:50.665513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f931-e880-44c0-b433-5d529a4e742a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:50.688766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166bb3-7c4b-4e18-83f7-ea900243e32b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:50.724954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:50.725841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.726128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.726402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] PATH_INFO: `/v3/users/f7b27651c3694603a41ee68ecfe6bec1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.727654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b27651c3694603a41ee68ecfe6bec1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:50.729147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:50.730778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 167/326] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:50 2022] GET /identity/v3/users/f7b27651c3694603a41ee68ecfe6bec1 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:50.736526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:50.764541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 160/327] 10.222.0.67 () {60 vars in 1134 bytes} [Fri May 27 09:14:50 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:14:50.854200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:50.865966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da40a6-b216-4848-a9ee-282efa408817 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:50.905477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:50.906154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:50.906437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:50.906713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:50.907594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] RBAC: Adding query filter params (role.id=d132772f9a6144b996dae740722fe305, user.id=f7b27651c3694603a41ee68ecfe6bec1, scope.system=all) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:50.907910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:50.909542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be338a-baf8-4a4b-88df-c4a5e7f7724b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:50.925484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 168/328] 10.222.0.67 () {56 vars in 1308 bytes} [Fri May 27 09:14:50 2022] GET /identity/v3/role_assignments?user.id=f7b27651c3694603a41ee68ecfe6bec1&scope.system=all&role.id=d132772f9a6144b996dae740722fe305 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:14:51.377991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee695a-d70f-4d88-9365-fbd1c301f450 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:51.378384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee695a-d70f-4d88-9365-fbd1c301f450 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:51.379109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee695a-d70f-4d88-9365-fbd1c301f450 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:51.380959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 161/329] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:51.388880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:51.389387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:51.389459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:51.414051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:51.415325 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:51.533255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 169/330] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:51.577821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee695a-d70f-4d88-9365-fbd1c301f450 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:51.811244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee695a-d70f-4d88-9365-fbd1c301f450 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:51.883379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:51.884773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:51.885234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:51.885660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:51.907895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:51.923183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:51.924131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:51.924954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:51.928056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 162/331] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:51.936517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:52.060910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:52.076744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459fe36-e63c-40af-9f82-6d83554ff941 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:52.125859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:52.126548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:52.126835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:52.127123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:52.127892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:52.128203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:52.130226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:52.140344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 170/332] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:52.149920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:52.183863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:52.409392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234fb92-7ff9-4183-ac04-ba3b93d7b267 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:52.481445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95f670-366d-441c-8f42-addddb652c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:52.483195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f670-366d-441c-8f42-addddb652c3d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:52.483718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f670-366d-441c-8f42-addddb652c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:52.484233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f670-366d-441c-8f42-addddb652c3d None admin] PATH_INFO: `/v3/users/c0ed43df8010430382146ad8c8c20250` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:52.489630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95f670-366d-441c-8f42-addddb652c3d None admin] RBAC: Authorizing `identity:get_user(user_id=c0ed43df8010430382146ad8c8c20250)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:52.492375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95f670-366d-441c-8f42-addddb652c3d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:52.496157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 163/333] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:52 2022] GET /identity/v3/users/c0ed43df8010430382146ad8c8c20250 => generated 293 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:52.505010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:52.749380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68411d-b5c6-4239-9f33-7d0c15ea29b6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:52.829512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4de60c-1dde-4f5b-ac6e-08715a50c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:52.831044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de60c-1dde-4f5b-ac6e-08715a50c9e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:52.831582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de60c-1dde-4f5b-ac6e-08715a50c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:52.831955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de60c-1dde-4f5b-ac6e-08715a50c9e7 None admin] PATH_INFO: `/v3/system/users/c0ed43df8010430382146ad8c8c20250/roles/eb2759eb02bc4973bf7af21b8c09d305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:52.834880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4de60c-1dde-4f5b-ac6e-08715a50c9e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0ed43df8010430382146ad8c8c20250, role_id=eb2759eb02bc4973bf7af21b8c09d305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:52.837544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4de60c-1dde-4f5b-ac6e-08715a50c9e7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:52.955220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 171/334] 10.222.0.67 () {58 vars in 1334 bytes} [Fri May 27 09:14:52 2022] PUT /identity/v3/system/users/c0ed43df8010430382146ad8c8c20250/roles/eb2759eb02bc4973bf7af21b8c09d305 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:14:54.155172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da5407-a150-4439-a47f-42deb3281a41 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:54.155903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da5407-a150-4439-a47f-42deb3281a41 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:54.156138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da5407-a150-4439-a47f-42deb3281a41 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:54.159567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 164/335] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:54.171056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aa1bf-e79c-48ce-8344-0a112ccd989a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:54.172862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aa1bf-e79c-48ce-8344-0a112ccd989a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:54.173638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aa1bf-e79c-48ce-8344-0a112ccd989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:54.188799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:54.212892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7e9aa1bf-e79c-48ce-8344-0a112ccd989a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:54.215497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e9aa1bf-e79c-48ce-8344-0a112ccd989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:54.322365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 172/336] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:54.400548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da5407-a150-4439-a47f-42deb3281a41 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:54.498992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:54.529161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da5407-a150-4439-a47f-42deb3281a41 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:54.570256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:54.571080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:54.571361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:54.571632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:54.585390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:54.593369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:54.594319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:54.595122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:54.596217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 165/337] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:54.603471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532229-7d81-4850-9662-deb53185abb6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:54.603783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532229-7d81-4850-9662-deb53185abb6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:54.604030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532229-7d81-4850-9662-deb53185abb6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:54.605513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 173/338] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:14:54.606770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:54.622473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:54.622779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:54.623020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:54.650988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:54.652200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:54.818075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59c7f6-92fc-4edc-bf58-6e745abd8f5c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:54.843277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 174/339] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:54.868604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:54.916249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:54.917394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:54.917852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:54.918312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:54.919669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:54.920184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:54.922997 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:54.928713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:54.953610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 166/340] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:54.953834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:54.963144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:55.000740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a5b32-ef79-4e60-aa12-74d3b0833c4b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:55.042184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d7a56-1ea0-4ba5-bfbc-1cc21fa213a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:55.043026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7a56-1ea0-4ba5-bfbc-1cc21fa213a9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.043309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7a56-1ea0-4ba5-bfbc-1cc21fa213a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.043579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7a56-1ea0-4ba5-bfbc-1cc21fa213a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.056929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d7a56-1ea0-4ba5-bfbc-1cc21fa213a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-920d7a56-1ea0-4ba5-bfbc-1cc21fa213a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:55.066422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:55.067837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:55.069846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:55.076182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 175/341] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:14:55.076182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa56a49-a896-4dcb-bea1-8672b0b8c2d0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.076182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa56a49-a896-4dcb-bea1-8672b0b8c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.076182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa56a49-a896-4dcb-bea1-8672b0b8c2d0 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.076964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 176/342] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:55.078083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa56a49-a896-4dcb-bea1-8672b0b8c2d0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:55.222981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa56a49-a896-4dcb-bea1-8672b0b8c2d0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:55.231895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803aa0-b808-4cd2-ab66-64b31074073b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:55.277631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:55.291696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b0955-2bef-4151-b9f5-f515ae5641f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:55.292400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b0955-2bef-4151-b9f5-f515ae5641f7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.292682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b0955-2bef-4151-b9f5-f515ae5641f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.292962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b0955-2bef-4151-b9f5-f515ae5641f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.293997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:55.295165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.303794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.303794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.303794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:55.303794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:55.303794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3d8d8-d702-4148-a948-6705750b0197 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:55.319083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 177/343] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:55.321610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.322045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.322528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.356821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:55.358945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:55.426039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:55.436365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b0955-2bef-4151-b9f5-f515ae5641f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:55.438462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b0955-2bef-4151-b9f5-f515ae5641f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:55.488505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 178/344] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:55.491682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:55.620852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 167/345] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:55.624344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40081fe2-5630-4e0d-8040-1ac968c42765 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.624859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40081fe2-5630-4e0d-8040-1ac968c42765 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.625351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40081fe2-5630-4e0d-8040-1ac968c42765 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.629517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 168/346] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:55.632441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40081fe2-5630-4e0d-8040-1ac968c42765 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:55.668728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd00f7-9425-42d9-99ea-618288c1d939 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:55.696694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:55.719221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b79ef9-dedb-45dd-8139-b47fc4b2e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:55.719891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79ef9-dedb-45dd-8139-b47fc4b2e277 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.720173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79ef9-dedb-45dd-8139-b47fc4b2e277 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.723467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79ef9-dedb-45dd-8139-b47fc4b2e277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.817524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79ef9-dedb-45dd-8139-b47fc4b2e277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:55.819276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79ef9-dedb-45dd-8139-b47fc4b2e277 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:55.887607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40081fe2-5630-4e0d-8040-1ac968c42765 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:55.899637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:55.932455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:55.933445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.933726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.934041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:55.954564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:55.970353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:55.977799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 169/347] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:55.978649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:55.989742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 179/348] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:55.991523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80264af-e755-44ea-af6e-9abf4e2710ca None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:55.991820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80264af-e755-44ea-af6e-9abf4e2710ca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:55.992157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80264af-e755-44ea-af6e-9abf4e2710ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.014512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e80264af-e755-44ea-af6e-9abf4e2710ca None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:56.015756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e80264af-e755-44ea-af6e-9abf4e2710ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:56.031326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:56.122509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 180/349] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:56.124902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d331a7-183c-464c-87ad-855b6578caed None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.125538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d331a7-183c-464c-87ad-855b6578caed None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.126043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d331a7-183c-464c-87ad-855b6578caed None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.129548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 181/350] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:56.130806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d331a7-183c-464c-87ad-855b6578caed None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:56.161905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80469bb3-70cb-482a-aef5-3e35f4df988c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.202378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.203661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.204147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.204643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.206174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:56.207949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:56.210475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 170/351] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:55 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:56.211759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:56.245088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:56.323411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d331a7-183c-464c-87ad-855b6578caed None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.367817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.368804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.369091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.369536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.370672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:56.371043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:56.372858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763cfb0-fff6-443b-8ae5-ce96f3305416 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:56.374175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662bd49-9363-4bca-867c-482a95c06bc7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.384563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 182/352] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:56.386415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.386783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.387134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.418795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:56.421225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:56.421455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.422612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.422897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.423175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.426676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:56.426881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:56.427047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:56.428018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 171/353] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:56 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:56.428877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:56.532298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 183/354] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:56.537494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:56.622026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:56.635112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d420348-6e5a-4b3d-86b0-eb2f65f9f2ea None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.685536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.686727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.687247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.687523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.689821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7eac-be2d-4f5f-a263-40f51bb2c192 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.704214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:56.720527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:56.721530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:14:56.722893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:56.724003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 172/355] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:14:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:56.730171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:56.756429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.757918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.758343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.758776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.768776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:56.770536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:56.776479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 184/356] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:14:56 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:56.778539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:56.781787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:56.886845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab5ba-c465-4a49-83f6-dce197e09b2a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.923967 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b3bfb-b3b3-49ff-8107-4a485dc4aab8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:56.952747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.953412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.953701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:56.953986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:56.996539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:56.997918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:56.999475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:56.999947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.002557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.003961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.006830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.010213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 185/357] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:14:56 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:57.011564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.066272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.068693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.157603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:57.204938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330f62-3790-4015-a362-3d6f4b1e0139 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.236416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 173/358] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:57.238017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.251844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:57.252766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.253081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.253417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.270305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:57.278479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:57.279522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:14:57.280390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 186/359] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:57.281075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.313233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:57.375666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127884bd-48d9-4124-8a53-9f18b8a19d47 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.430043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:57.430875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d906b9d-467a-4b14-9180-a82cd11dad13 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.431338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.431338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.431591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.432532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:57.432846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.434657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.445568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 174/360] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:57.446735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.480360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:57.491309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:57.492403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.492861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.493310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.494830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=d132772f9a6144b996dae740722fe305, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:57.495349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.498999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f955-1f25-49d7-a953-d1881f98af91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.510255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 187/361] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=d132772f9a6144b996dae740722fe305 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:57.512828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d156d-f9f6-482a-a7d5-aa40d83afb49 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.513617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d156d-f9f6-482a-a7d5-aa40d83afb49 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.514129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d156d-f9f6-482a-a7d5-aa40d83afb49 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.517591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 188/362] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:14:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:14:57.519050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d156d-f9f6-482a-a7d5-aa40d83afb49 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.595393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a3d0-1db2-4a99-8431-8a566366503a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.621220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:57.649481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:57.650199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.650483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.650759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.651779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:57.652255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.654425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.661616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 175/363] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:57.663076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.703852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d156d-f9f6-482a-a7d5-aa40d83afb49 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.754651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:57.755683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.756093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.757561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.757874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.759426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.761695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 189/364] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:57.766444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:57.847500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a848e2-14f4-4af2-b1fb-bf554bb52a97 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.858544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:57.921186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:57.922986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.923285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.923543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:57.924317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:57.924654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:57.926645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1ca0-9fde-43a0-9ea7-128eadcdf388 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:57.936046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99e1a6-9a7a-4b04-9faa-98780c47da28 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:57.960752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 176/365] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:57.962173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:57.962467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:57.962754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:58.006898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:58.007528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:58.007816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:58.008095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:58.009736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:14:58.014247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:14:58.103859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:58.105598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:58.112156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:58.178829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 177/366] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:14:58.179740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:58.233418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:58.323128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 190/367] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:58.323936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:58.359846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a294-8222-4824-a1d8-37a20e632521 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:58.407469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:58.408419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:58.408708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:58.408986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:58.411251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:58.412827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:58.414622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 178/368] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:14:58 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:58.415513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:58.494547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac957-a6b4-491a-ba15-1f676091ca91 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:58.509023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:58.540474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:58.541381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:58.541778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:58.542123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:58.582885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:58.626764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:58.629087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:58.643198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0afc61-c474-49e2-9f5a-35890bc6b03e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:58.709158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:58.710508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:58.711016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:58.711496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:58.732985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:14:58.744170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 191/369] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:14:58.745216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:14:58.758660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:14:58.762210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 179/370] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:14:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:14:58.764891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:58.885653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:58.896611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:58.900996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b008aff-30af-4085-af52-b41970ed5929 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:58.943654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:58.944467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:58.944757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:58.945022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:58.947056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=d132772f9a6144b996dae740722fe305, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:58.947399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:58.949024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:58.963556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 180/371] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:14:58 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=d132772f9a6144b996dae740722fe305 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:58.964654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:58.982111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6654360-1ff4-42a0-b24f-50d1edd84453 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:59.061565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:59.062996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:59.063474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:59.064655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:59.072370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:59.072370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:59.074846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 192/372] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:58 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:59.076315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:59.245075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3276-d735-412f-bcc1-4c436804871e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:59.281410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123aaa1a-6954-41c4-bb11-783dde2c2533 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:59.284264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:59.285443 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:59.285802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:59.286231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] PATH_INFO: `/v3/projects/41e0cce5349a484a984be8bf5c634f8a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:59.293266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] RBAC: Authorizing `identity:get_project(project_id=41e0cce5349a484a984be8bf5c634f8a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:59.294767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:59.296977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 181/373] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:14:58 2022] GET /identity/v3/projects/41e0cce5349a484a984be8bf5c634f8a => generated 344 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:59.297841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:59.337326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:59.345223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:59.346319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:59.346819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:59.347324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:59.348747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:59.349258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:59.351763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:59.368964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 193/374] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:14:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:59.370374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:59.413875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:59.564652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605e8e-b865-4406-9d13-7ad216885d1e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:59.651962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9036315-35bf-415c-9995-2ba1fb925769 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:59.670959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:59.672108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:59.672416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:59.672695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] PATH_INFO: `/v3/groups/3de4904aa1c94ee09801da095df5e762` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:59.685915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] RBAC: Authorizing `identity:get_group(group_id=3de4904aa1c94ee09801da095df5e762)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:59.687513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:59.689667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 194/375] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:14:59 2022] GET /identity/v3/groups/3de4904aa1c94ee09801da095df5e762 => generated 229 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:59.690348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:59.698079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:59.698992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:59.699277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:59.699561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:59.701623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:59.702393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:59.704450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 182/376] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:14:59 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:59.705283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:59.817839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:59.818845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:14:59.821771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f8f2f-4aff-48a2-8a5d-f7ef54be5f95 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:14:59.868873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:14:59.869577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:14:59.869842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:14:59.870115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:14:59.870963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] RBAC: Adding query filter params (group.id=3de4904aa1c94ee09801da095df5e762, role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=41e0cce5349a484a984be8bf5c634f8a) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:14:59.871281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:14:59.874909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:14:59.885304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 183/377] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:14:59 2022] GET /identity/v3/role_assignments?group.id=3de4904aa1c94ee09801da095df5e762&scope.project.id=41e0cce5349a484a984be8bf5c634f8a&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:14:59.886174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:14:59.944994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85ff8e-92a0-4a81-88c3-5a46dff80d26 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:00.024990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:00.027051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:00.030223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:00.031120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] PATH_INFO: `/v3/users/c0ed43df8010430382146ad8c8c20250` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:00.036940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] RBAC: Authorizing `identity:get_user(user_id=c0ed43df8010430382146ad8c8c20250)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:00.043045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:00.050901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 195/378] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:14:59 2022] GET /identity/v3/users/c0ed43df8010430382146ad8c8c20250 => generated 293 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:00.058134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:00.182202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73302ac-0d3d-4022-99da-6be055bfaea5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:00.221165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:00.222275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:00.222758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:00.223228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:00.224318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:00.224947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:00.226640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac3182-3c9e-43ec-bdab-75b5652516ac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:00.240249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 184/379] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:14:59 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 260 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:00.386901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bade-1517-4814-bce0-eb28fe4f594c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:00.433684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:00.446841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:00.447866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:00.448355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:00.448738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:00.449860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] RBAC: Adding query filter params (role.id=eb2759eb02bc4973bf7af21b8c09d305, user.id=c0ed43df8010430382146ad8c8c20250, scope.system=all) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:00.450188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:00.452234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75d05b-856a-403f-94d8-14b690fbe4ee None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:00.475013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 196/380] 10.222.0.67 () {56 vars in 1308 bytes} [Fri May 27 09:15:00 2022] GET /identity/v3/role_assignments?user.id=c0ed43df8010430382146ad8c8c20250&scope.system=all&role.id=eb2759eb02bc4973bf7af21b8c09d305 => generated 510 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:00.594189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eb986-8ea4-4e2b-ac74-3506df468ff8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:00.595298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eb986-8ea4-4e2b-ac74-3506df468ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:00.595814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eb986-8ea4-4e2b-ac74-3506df468ff8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:00.598555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 185/381] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:00.606617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:00.607143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:00.607603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:00.645905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:00.648107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:00.784544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 197/382] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:00.809788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eb986-8ea4-4e2b-ac74-3506df468ff8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:00.852636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:00.948314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eb986-8ea4-4e2b-ac74-3506df468ff8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:00.987432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a767f04-582f-43c8-a4e8-dcbf5372008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:00.988856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a767f04-582f-43c8-a4e8-dcbf5372008e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:00.989138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a767f04-582f-43c8-a4e8-dcbf5372008e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:00.989415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a767f04-582f-43c8-a4e8-dcbf5372008e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.002425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a767f04-582f-43c8-a4e8-dcbf5372008e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2a767f04-582f-43c8-a4e8-dcbf5372008e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:01.011211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:01.012147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:01.012977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:01.016354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 186/383] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:01.020024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.100504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4b7a1-6f66-4c37-9a69-5b9b3fbda0c5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.101136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4b7a1-6f66-4c37-9a69-5b9b3fbda0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.101626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4b7a1-6f66-4c37-9a69-5b9b3fbda0c5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.104571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 187/384] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:15:01.109159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.109771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.110324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.136666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6f0de-286a-4494-ad81-49b7b9034909 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.138595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:01.142195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:01.153035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:01.186537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.187872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.188502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.189275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.190161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:01.190651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:01.192779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:01.205634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 198/385] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:01.234127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.238996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 188/386] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:15:01.279570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.315270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:01.365741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc3fd0-a6bf-4dab-a362-d76d53c19f10 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.419907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.421189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.421959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.422450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.424006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:01.424684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884642bf-2f4e-4963-b174-973f62ebef0b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.430025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:01.432365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 199/387] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:01 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:01.449737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.474921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.476138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.476597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.477053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.491863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:01.505559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:01.506572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:01.507699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:01.511171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 189/388] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:01.517424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.534258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:01.641042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:01.655458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74a2f-b24a-49a0-8b21-c5a12bcbd9fe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.656065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517fa7b-a541-41d4-970a-494147c1e924 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.697867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.698985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.699529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.700003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.701261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:01.701815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:01.703564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:01.716090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 190/389] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:01.716570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.717489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.717775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.718056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.719444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:01.723208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:01.723208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 200/390] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:01 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:01.729234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.733790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:01.863407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b57ad-3cc1-4db1-b4b2-574b74beb882 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.907085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.907452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.908016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.910187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/groups/259501173ec146ca89f5565c99c6ab49/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.913005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] RBAC: Authorizing `identity:create_grant(project_id=d552fcbcb9b147e292f8c10cf6ecfe72, group_id=259501173ec146ca89f5565c99c6ab49, role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:01.914799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:01.930715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163933-e3b7-4f93-b13f-f6f0cbb6d21f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:01.952283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:01.982684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:01.983574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:01.984346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:01.984474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:01.984669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:01.986084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:01.988439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:01.990329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 201/391] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:01 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:01.993767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 191/392] 10.222.0.67 () {58 vars in 1442 bytes} [Fri May 27 09:15:01 2022] PUT /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/groups/259501173ec146ca89f5565c99c6ab49/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:02.007052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:02.206144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5f0cc-3300-487e-9ec6-62054481cb44 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:02.272347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f10a4-b06e-4ba6-a26c-4e5ca270074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:02.273317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f10a4-b06e-4ba6-a26c-4e5ca270074f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:02.273604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f10a4-b06e-4ba6-a26c-4e5ca270074f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:02.273883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f10a4-b06e-4ba6-a26c-4e5ca270074f None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:02.275174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f10a4-b06e-4ba6-a26c-4e5ca270074f None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:02.276714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f10a4-b06e-4ba6-a26c-4e5ca270074f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:02.278834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 202/393] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:02 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:02.284394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:02.403265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c0c6-a686-4b1f-b923-f4128c33ca98 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:02.441484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0fa89-52bf-4268-90cd-2f52fb847025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:02.442389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fa89-52bf-4268-90cd-2f52fb847025 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:02.442709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fa89-52bf-4268-90cd-2f52fb847025 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:02.442986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fa89-52bf-4268-90cd-2f52fb847025 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/groups/259501173ec146ca89f5565c99c6ab49/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:02.445161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fa89-52bf-4268-90cd-2f52fb847025 None admin] RBAC: Authorizing `identity:create_grant(project_id=d552fcbcb9b147e292f8c10cf6ecfe72, group_id=259501173ec146ca89f5565c99c6ab49, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:02.446619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fa89-52bf-4268-90cd-2f52fb847025 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:02.520189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 192/394] 10.222.0.67 () {58 vars in 1442 bytes} [Fri May 27 09:15:02 2022] PUT /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72/groups/259501173ec146ca89f5565c99c6ab49/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:02.854455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48dc3b-773c-412c-bcc3-12f44ec7ec3f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:02.854945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48dc3b-773c-412c-bcc3-12f44ec7ec3f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:02.854945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48dc3b-773c-412c-bcc3-12f44ec7ec3f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:02.856642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 203/395] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:02.862550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:02.863092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:02.863164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:02.882657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:02.883866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:02.950323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:02.963072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 193/396] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:02.986062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48dc3b-773c-412c-bcc3-12f44ec7ec3f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:03.056597 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:03.127490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48dc3b-773c-412c-bcc3-12f44ec7ec3f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:03.185840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197499d2-0fee-4eb4-bed2-6a5a8a36ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:03.186684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197499d2-0fee-4eb4-bed2-6a5a8a36ac8c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:03.186968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197499d2-0fee-4eb4-bed2-6a5a8a36ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:03.187246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197499d2-0fee-4eb4-bed2-6a5a8a36ac8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:03.207758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197499d2-0fee-4eb4-bed2-6a5a8a36ac8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-197499d2-0fee-4eb4-bed2-6a5a8a36ac8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:03.215874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:03.216912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:03.218723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 204/397] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:03.224703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:03.425780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398dbd2-3fb3-478d-bfba-3287a5928159 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:03.426150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398dbd2-3fb3-478d-bfba-3287a5928159 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:03.426320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398dbd2-3fb3-478d-bfba-3287a5928159 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:03.428004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 205/398] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:03.433855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:03.434457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:03.435066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:03.489721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76850e13-8935-4e82-b745-00604b5699f0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:03.500725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:03.502271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:03.568135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:03.569349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:03.569856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:03.570347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:03.571688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:03.572247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:03.575074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:03.607223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 194/399] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:03.613787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:03.696801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 206/400] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:03.715751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:03.732151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:03.796014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:03.812908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ec5b0-78ad-4def-8e3a-c44d521a0a08 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:03.883883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:03.886537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:03.887532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:03.888238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:03.890762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:03.893756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:03.898215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 195/401] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:03 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:03.906197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:03.947942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c91a3e-e77c-4021-b389-57253e9fb4b9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.045119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.045964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.046248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.046515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.073680 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:04.092350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:04.093459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:04.094356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:04.097029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 207/402] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:15:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:04.102306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:04.142993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74cd97-2703-49e5-a0c6-69fcde1b42a3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.183824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:04.214325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9b664-af8e-45b1-be62-5cb71bde55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.215636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b664-af8e-45b1-be62-5cb71bde55aa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.216160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b664-af8e-45b1-be62-5cb71bde55aa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.216711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b664-af8e-45b1-be62-5cb71bde55aa None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.218146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9b664-af8e-45b1-be62-5cb71bde55aa None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:04.221875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9b664-af8e-45b1-be62-5cb71bde55aa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:04.224362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 196/403] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:03 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:04.225954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad81c6-26fa-4273-bd71-d459ed5d03ce None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.232245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad81c6-26fa-4273-bd71-d459ed5d03ce None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.232825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad81c6-26fa-4273-bd71-d459ed5d03ce None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.234914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 197/404] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:04.236095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad81c6-26fa-4273-bd71-d459ed5d03ce None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:04.273992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:04.281695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafbea5-2846-4112-8382-79cbe6b245bd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.329631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.330603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.331073 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.332199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.333205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:04.333795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:04.335533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8edb52-5f4a-48b8-ac1e-f288137d1ba2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:04.347701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 208/405] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:04.349887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.350511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.350987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.372452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:04.374053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:04.428727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad81c6-26fa-4273-bd71-d459ed5d03ce None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.453950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 209/406] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:04.454836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:04.496528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.498143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.498906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.499607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/groups/259501173ec146ca89f5565c99c6ab49/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.504166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] RBAC: Authorizing `identity:create_grant(project_id=26263b5d1bd4408382b3e5e48f9f5268, group_id=259501173ec146ca89f5565c99c6ab49, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:04.507290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:04.578473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:04.595236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e46093-edf9-4fb4-9f26-85cd7cbeaf87 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.624495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 198/407] 10.222.0.67 () {58 vars in 1442 bytes} [Fri May 27 09:15:04 2022] PUT /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/groups/259501173ec146ca89f5565c99c6ab49/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:04.625602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:04.658454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.661260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.662281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.663100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.666112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:04.669456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:04.673608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 210/408] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:04 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:04.684634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:04.739185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:04.806271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4beb0-093d-4b7a-99ed-5c3469742194 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.847651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd44f0-5122-4ed1-b95d-4ba6d69c2b3e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:04.887429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.888705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.889204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.889670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.891751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:04.894940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:04.900009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 211/409] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:04 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:04.903946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:04.930664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:04.933066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:04.933771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:04.935125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:04.950030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:04.954587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:04.962652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:04.963692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:04.964590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 199/410] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:04.969897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:05.136452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80372551-529d-400b-941e-28cd217ce8bf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:05.151508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4f08e-58f0-4e7d-a98a-d01fe76dd927 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:05.173941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:05.212720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:05.213424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.213820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.214009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.214758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:05.215066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:05.216550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f4f9-25f5-4061-9602-cf0bb81e214b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:05.227885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 200/411] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:05.229372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888756c-f13f-4e74-b065-e06d3be13f5f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.229714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888756c-f13f-4e74-b065-e06d3be13f5f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.230000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888756c-f13f-4e74-b065-e06d3be13f5f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.231715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 201/412] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:05.233710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90fefa-bfa6-46ee-9c7d-67d5a9c31da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:05.235056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90fefa-bfa6-46ee-9c7d-67d5a9c31da3 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.235662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90fefa-bfa6-46ee-9c7d-67d5a9c31da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.236141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90fefa-bfa6-46ee-9c7d-67d5a9c31da3 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/groups/259501173ec146ca89f5565c99c6ab49/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.239995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90fefa-bfa6-46ee-9c7d-67d5a9c31da3 None admin] RBAC: Authorizing `identity:create_grant(project_id=26263b5d1bd4408382b3e5e48f9f5268, group_id=259501173ec146ca89f5565c99c6ab49, role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:05.241202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888756c-f13f-4e74-b065-e06d3be13f5f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:05.242280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90fefa-bfa6-46ee-9c7d-67d5a9c31da3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:05.317653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 212/413] 10.222.0.67 () {58 vars in 1442 bytes} [Fri May 27 09:15:04 2022] PUT /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268/groups/259501173ec146ca89f5565c99c6ab49/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:05.319314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81765-8835-4fe2-aa9e-1eb54acf87d9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.319824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81765-8835-4fe2-aa9e-1eb54acf87d9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.320317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81765-8835-4fe2-aa9e-1eb54acf87d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.363690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7dd81765-8835-4fe2-aa9e-1eb54acf87d9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:05.365501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7dd81765-8835-4fe2-aa9e-1eb54acf87d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:05.431608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888756c-f13f-4e74-b065-e06d3be13f5f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:05.479230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:05.481322 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.481843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.482341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] PATH_INFO: `/v3/groups/3de4904aa1c94ee09801da095df5e762` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.483918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] RBAC: Authorizing `identity:get_group(group_id=3de4904aa1c94ee09801da095df5e762)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:05.486264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:05.489263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 202/414] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:05 2022] GET /identity/v3/groups/3de4904aa1c94ee09801da095df5e762 => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:05.497792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:05.556907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:05.579595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 213/415] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:05.581857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528012c-37e7-432b-8857-b4c57d7bcf68 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.582160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528012c-37e7-432b-8857-b4c57d7bcf68 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.582443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528012c-37e7-432b-8857-b4c57d7bcf68 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.584494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 214/416] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:05.593968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.594296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.594518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.621715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:05.623838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:05.639437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab94d17-2967-4755-bb42-58b773bc3c14 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:05.640290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:05.699603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:05.700188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.700755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.701263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] PATH_INFO: `/v3/projects/41e0cce5349a484a984be8bf5c634f8a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.703556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] RBAC: Authorizing `identity:get_project(project_id=41e0cce5349a484a984be8bf5c634f8a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:05.706327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:05.710571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 203/417] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:05 2022] GET /identity/v3/projects/41e0cce5349a484a984be8bf5c634f8a => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:05.712096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:05.728844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 215/418] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:05.730115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:05.877891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfced3-7257-4448-912d-67a8f3bafd1c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:05.909264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce9d4-5617-4aac-9362-ede735cb97a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:05.930547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:05.934336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:05.935678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.936162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.936679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] PATH_INFO: `/v3/projects/41e0cce5349a484a984be8bf5c634f8a/groups/3de4904aa1c94ee09801da095df5e762/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:05.939056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] RBAC: Authorizing `identity:create_grant(project_id=41e0cce5349a484a984be8bf5c634f8a, group_id=3de4904aa1c94ee09801da095df5e762, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:05.941386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:05.985960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:05.987233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:05.988278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:05.988829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:06.010351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:06.024589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 216/419] 10.222.0.67 () {58 vars in 1442 bytes} [Fri May 27 09:15:05 2022] PUT /identity/v3/projects/41e0cce5349a484a984be8bf5c634f8a/groups/3de4904aa1c94ee09801da095df5e762/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:06.027481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:06.029009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:06.031428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:06.036981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:06.037084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 204/420] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:15:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:06.043358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:06.046388 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:06.271098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270a7f8-3f8f-4e85-9e1b-fe6f3b5bc30d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:06.311995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ab6e9-5e66-4f55-8ce7-83b5ee72ef51 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:06.326458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:06.327981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:06.328489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:06.328931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:06.345031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:06.356549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:06.357629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:06.358426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:06.361114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 217/421] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:06.365906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:06.365906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:06.365906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:06.365906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:06.366377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:06.366923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:06.367630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:06.368773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:06.383282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 205/422] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:06.390855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:06.441340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:06.454523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:06.498658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb33c-d69b-4527-8f2e-1bea2cb67af7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:06.520123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0721-a24f-47bc-b033-0c1632ec1997 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:06.539470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:06.540069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:06.540383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:06.540669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:06.541425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] RBAC: Adding query filter params (name=member) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:06.541737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:06.543153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:06.553943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 218/423] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:06.561108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:06.564197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:06.565098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:06.565553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:06.566530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:06.700978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fd30-af19-4e0b-8168-60507aa31892 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:06.735232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:06.747409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:06.751763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:06.751763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:06.751763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:06.765236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:06.766975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:06.799918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:06.848056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:06.849959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:06.970205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 219/424] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:15:06.977077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:07.037380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 206/425] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:07.044490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:07.050458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:07.149424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c3b1-64c1-4f64-8b62-a156c3bdef14 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:07.188317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:07.189390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:07.189688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:07.189973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:07.191805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:07.193592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:07.196456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 220/426] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:06 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:07.201455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:07.321177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63528e3-ba23-48dc-94a6-941fe7568fc8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:07.324706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:07.360357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:07.361233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:07.361512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:07.361790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:07.362353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c26f4-9bdc-4ff6-9a6f-53676be7975a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:07.363536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:07.365538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:07.367778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 221/427] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:07 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:07.379751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:07.400180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:07.409274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:07.413741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:07.413741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:07.413741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] PATH_INFO: `/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:07.413741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] RBAC: Authorizing `identity:get_project(project_id=d552fcbcb9b147e292f8c10cf6ecfe72)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:07.414107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:07.421409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 207/428] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:07 2022] GET /identity/v3/projects/d552fcbcb9b147e292f8c10cf6ecfe72 => generated 298 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:07.423024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:07.539518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803af6-90d5-4fb6-8dda-51716c9b0d76 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:07.612475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:07.613603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:07.613888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:07.614162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:07.615023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=d132772f9a6144b996dae740722fe305, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:07.615337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:07.616857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:07.630088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 222/429] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:15:07 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=d132772f9a6144b996dae740722fe305 => generated 611 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:07.658872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f3bd7-e87f-49c2-afe0-35ee739fd81a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:07.722339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21493155-2218-4868-969c-dc1c8330019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:07.723304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21493155-2218-4868-969c-dc1c8330019e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:07.723648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21493155-2218-4868-969c-dc1c8330019e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:07.723938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21493155-2218-4868-969c-dc1c8330019e None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:07.725403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21493155-2218-4868-969c-dc1c8330019e None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:07.726939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21493155-2218-4868-969c-dc1c8330019e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:07.729136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 208/430] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:07 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:07.739450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:07.778825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:07.897925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b5a1-2b83-47c2-8446-a4ee982eacae None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:07.945200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:07.945890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:07.946178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:07.946520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:07.947402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:07.947716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:07.949285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428091-0c9a-4ee5-821a-9c52016b1da9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:07.957225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 223/431] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:15:07 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=d552fcbcb9b147e292f8c10cf6ecfe72&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:08.156280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfc10-5a62-4e42-a2ef-643d6768ec2a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.156872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfc10-5a62-4e42-a2ef-643d6768ec2a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.156872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfc10-5a62-4e42-a2ef-643d6768ec2a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.158459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 209/432] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:08.165069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6133f6-e8d2-4557-b67d-9deedc19e502 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.165602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6133f6-e8d2-4557-b67d-9deedc19e502 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.165602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6133f6-e8d2-4557-b67d-9deedc19e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.187281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2a6133f6-e8d2-4557-b67d-9deedc19e502 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:08.188542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a6133f6-e8d2-4557-b67d-9deedc19e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:08.315437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 224/433] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:08.338784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bfc10-5a62-4e42-a2ef-643d6768ec2a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:08.357330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2954d3-4d9a-4a31-b3e3-4c742f4bcf80 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.357683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2954d3-4d9a-4a31-b3e3-4c742f4bcf80 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.357917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2954d3-4d9a-4a31-b3e3-4c742f4bcf80 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.359902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 225/434] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:08.366945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.367600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.368146 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.398666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:08.401216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:08.423677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:08.467104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:08.518282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 226/435] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:15:08.548652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bfc10-5a62-4e42-a2ef-643d6768ec2a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:08.558454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:08.614454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:08.616109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.616466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.616734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.630969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:08.642120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:08.643485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:08.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 210/436] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:08.649392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:08.719172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37f0dc-cf28-476d-9957-288b100baee2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:08.770317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:08.771157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.771440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.771726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.787200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:08.795802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:08.797887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:08.799374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 227/437] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:15:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:08.807153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:08.823131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:08.840263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918168a-d1d1-4188-a820-8cdd6ccee037 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:08.875861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:08.890043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:08.890755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:08.891071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:08.891339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:08.892335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:08.892666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:08.895065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:08.913262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 211/438] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:08.914211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:08.959731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9c912-f14a-45e1-98a6-a98e5b4fa128 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.004994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.005767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.006065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.006310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.007077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:09.007386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.008880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.020594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 228/439] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:09.025793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.050411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30aca-4096-48e2-8787-818f23cc6896 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.100665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d9d38-6081-4561-8efc-99bb8dba5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.101327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9d38-6081-4561-8efc-99bb8dba5144 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.101616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9d38-6081-4561-8efc-99bb8dba5144 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.101900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9d38-6081-4561-8efc-99bb8dba5144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.121166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.164134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8fcd4-2538-4a77-a877-4a60eebecc6f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.173919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.192218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d9d38-6081-4561-8efc-99bb8dba5144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.193755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d9d38-6081-4561-8efc-99bb8dba5144 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.205529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110e110-1b13-4996-b3e7-5141002f7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.206183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e110-1b13-4996-b3e7-5141002f7f0a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.206975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e110-1b13-4996-b3e7-5141002f7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.207253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e110-1b13-4996-b3e7-5141002f7f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.277917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110e110-1b13-4996-b3e7-5141002f7f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.279296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110e110-1b13-4996-b3e7-5141002f7f0a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.311767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 212/440] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:09.311767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d65-3456-4be2-8b29-8bcd34f05f37 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.311767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d65-3456-4be2-8b29-8bcd34f05f37 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.311767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d65-3456-4be2-8b29-8bcd34f05f37 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.311767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 213/441] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:09.314625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d65-3456-4be2-8b29-8bcd34f05f37 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.360311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.393048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 229/442] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:09.394952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.395310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.395589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.408710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.414852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:09.416083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:09.426264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d65-3456-4be2-8b29-8bcd34f05f37 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.464854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.465988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.466313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.466553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.467746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.469235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.470927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 214/443] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:09.471705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.491472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 230/444] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:09.492651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.592115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243bcc-6688-4705-91f1-a4c680b1adce None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.606153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbd500-b3e5-456c-b455-cd03d15a33de None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.607730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.627212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.628628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.628910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.629181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] PATH_INFO: `/v3/projects/26263b5d1bd4408382b3e5e48f9f5268` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.630398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=26263b5d1bd4408382b3e5e48f9f5268)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.631868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.633769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 215/445] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/projects/26263b5d1bd4408382b3e5e48f9f5268 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:09.634436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.649117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.650197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.650430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.650709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.651918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.653421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.659720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 231/446] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:09.659720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.663811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.748833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142895f-0b35-4d5d-afe5-293508a6e9f8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.759927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee8f1-76d3-4700-8f68-a3af86388f86 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.782740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.783536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.783821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.784102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.794239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.794978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.795282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.795527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] PATH_INFO: `/v3/groups/259501173ec146ca89f5565c99c6ab49` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.796263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:09.796993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] RBAC: Authorizing `identity:get_group(group_id=259501173ec146ca89f5565c99c6ab49)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.798462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.800606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 232/447] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/groups/259501173ec146ca89f5565c99c6ab49 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:09.801367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:09.805032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:09.805944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:09.806731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 216/448] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:09.807488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.847536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.914056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:09.920488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3562-cc7d-456b-9bb6-da3c493cfdee None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.935242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641acd-d1f2-411d-ac86-81f1a5316a03 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:09.961944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.962601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.962883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.963162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.963998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=d132772f9a6144b996dae740722fe305, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:09.964316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.965900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.979415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:09.980087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:09.980409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:09.980695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:09.981541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] RBAC: Adding query filter params (group.id=259501173ec146ca89f5565c99c6ab49, role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=26263b5d1bd4408382b3e5e48f9f5268) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:09.981858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:09.983358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:09.983552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 233/449] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=d132772f9a6144b996dae740722fe305 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:09.984547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:09.991583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 217/450] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/role_assignments?group.id=259501173ec146ca89f5565c99c6ab49&scope.project.id=26263b5d1bd4408382b3e5e48f9f5268&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:10.160525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605f73-2507-4c0d-bdf7-b849b52ccec9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:10.164179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:10.222712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:10.224898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:10.225367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:10.225818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:10.227145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:10.228404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:10.230150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:10.245629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 234/451] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:10.251681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:10.403544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c0bc-ca39-40e3-97a0-9e788d29d5e4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:10.450875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:10.451802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:10.452175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:10.452658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:10.474571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:10.547569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:10.549604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:10.677675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 218/452] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:15:10.683672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:10.790565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6773326-9a20-45ff-bed1-30e5f3a11af0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:10.827618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:10.828602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:10.828891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:10.829172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] PATH_INFO: `/v3/projects/41e0cce5349a484a984be8bf5c634f8a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:10.830430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] RBAC: Authorizing `identity:get_project(project_id=41e0cce5349a484a984be8bf5c634f8a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:10.831906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:10.833645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 235/453] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:15:10 2022] GET /identity/v3/projects/41e0cce5349a484a984be8bf5c634f8a => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:10.839479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:10.916615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:10.971088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfa041-ad64-462e-854e-15ceae025102 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:11.006910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b23faf-5e25-41f4-aa44-4026bc244dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:11.007771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b23faf-5e25-41f4-aa44-4026bc244dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:11.008061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b23faf-5e25-41f4-aa44-4026bc244dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:11.008381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b23faf-5e25-41f4-aa44-4026bc244dc8 None admin] PATH_INFO: `/v3/groups/3de4904aa1c94ee09801da095df5e762` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:11.009597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b23faf-5e25-41f4-aa44-4026bc244dc8 None admin] RBAC: Authorizing `identity:get_group(group_id=3de4904aa1c94ee09801da095df5e762)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:11.011050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b23faf-5e25-41f4-aa44-4026bc244dc8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:11.012704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 219/454] 10.222.0.67 () {56 vars in 1180 bytes} [Fri May 27 09:15:10 2022] GET /identity/v3/groups/3de4904aa1c94ee09801da095df5e762 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:11.018878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:11.054126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:11.125459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16f8b-c96d-4cf3-a11e-86d729cc51ec None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:11.160926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:11.161638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:11.162011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:11.162339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:11.163223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] RBAC: Adding query filter params (group.id=3de4904aa1c94ee09801da095df5e762, role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=41e0cce5349a484a984be8bf5c634f8a) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:11.163586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:11.165123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e115e0-896c-448e-b1a6-4b21bee0c5ae None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:11.171454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 236/455] 10.222.0.67 () {56 vars in 1376 bytes} [Fri May 27 09:15:11 2022] GET /identity/v3/role_assignments?group.id=3de4904aa1c94ee09801da095df5e762&scope.project.id=41e0cce5349a484a984be8bf5c634f8a&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:15.239560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996545-7d8a-48c5-97e6-7f4fd30f8b2d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:15.240863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996545-7d8a-48c5-97e6-7f4fd30f8b2d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:15.241513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996545-7d8a-48c5-97e6-7f4fd30f8b2d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:15.244179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 220/456] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:15.252420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f2d8-7397-4ae4-8093-c6f7e0566a79 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:15.253688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f2d8-7397-4ae4-8093-c6f7e0566a79 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:15.254379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f2d8-7397-4ae4-8093-c6f7e0566a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:15.286649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e5c8f2d8-7397-4ae4-8093-c6f7e0566a79 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:15.289210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5c8f2d8-7397-4ae4-8093-c6f7e0566a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:15.421145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 237/457] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:15:15.464699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996545-7d8a-48c5-97e6-7f4fd30f8b2d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:15.624599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996545-7d8a-48c5-97e6-7f4fd30f8b2d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:15.652279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:15.680355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90009b8-e894-4994-b92b-322145594bbe None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:15.681230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90009b8-e894-4994-b92b-322145594bbe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:15.682266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90009b8-e894-4994-b92b-322145594bbe None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:15.682808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:15.683619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:15.683906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:15.684188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:15.687119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 238/458] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:15.696100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:15.697042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:15.698493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:15.729731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:15.731299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:15.742459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:15.745035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:15.780892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:15.782619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:15.793057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:15.793057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:15.793057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:15.793057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:15.793057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 221/459] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:15.796094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:15.808105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:15.898617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 239/460] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:15.975024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:16.047669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328982fe-f0cb-45c8-81df-222c6a5cdfbc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:16.121859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:16.122551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.122843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.123121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.123870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:16.124178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:16.125657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d8eaa-b7e2-43b5-b8a0-52307d9598b0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:16.149667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 222/461] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:16.154558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d47e-3de6-4079-bc89-17b308a46585 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.155233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d47e-3de6-4079-bc89-17b308a46585 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.155666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d47e-3de6-4079-bc89-17b308a46585 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.157402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 223/462] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:16.158286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14d47e-3de6-4079-bc89-17b308a46585 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:16.182840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505992f-1f03-44cc-9ad3-9ea13f1cb257 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:16.208166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:16.258452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:16.260876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.261582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.262267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.283859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:16.287207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5ce63d49-de8f-43a6-a48f-2b9184c12f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:16.333979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:16.335902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:16.338028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:16.338028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:16.338028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:16.338028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:16.348704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 240/463] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:16.351665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.351905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14d47e-3de6-4079-bc89-17b308a46585 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:16.353149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.353838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.387137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:16.389880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:16.395332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:16.418534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bbcc6-8198-464d-bd0b-b02e6ead89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:16.419487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bbcc6-8198-464d-bd0b-b02e6ead89be None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.419912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bbcc6-8198-464d-bd0b-b02e6ead89be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.420366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bbcc6-8198-464d-bd0b-b02e6ead89be None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.421849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bbcc6-8198-464d-bd0b-b02e6ead89be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:16.425400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bbcc6-8198-464d-bd0b-b02e6ead89be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:16.544870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 241/465] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:16.547155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:16.548505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 224/465] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:15:16 2022] POST /identity/v3/users => generated 246 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:16.685862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b032b9-c7b0-4dd7-91f8-f7d8cd7ec8fb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.686822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b032b9-c7b0-4dd7-91f8-f7d8cd7ec8fb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.687593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b032b9-c7b0-4dd7-91f8-f7d8cd7ec8fb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.691453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 225/466] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:16.698839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b032b9-c7b0-4dd7-91f8-f7d8cd7ec8fb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:16.810856 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8984b-31ba-4bf2-b53d-9e7a90088591 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:16.873068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:16.873347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:16.874436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.874871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.875319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.876574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:16.877301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:16.879654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f838f-47bc-4e12-8de2-b167bc26093c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:16.893057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:16.903634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 242/467] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:16.905434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.905434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.905434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.905850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b032b9-c7b0-4dd7-91f8-f7d8cd7ec8fb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:16.935045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:16.936844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:16.966630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:16.968055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:16.968584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:16.969076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:16.987771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:16.990485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7230103b-c959-4a2b-8f05-29973531be57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:17.028911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:17.030626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:17.032300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:17.032300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:17.032300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:17.032300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:17.032300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 226/468] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:17.033768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70cf6-d962-4ce3-a22c-95b21ac4688b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.034201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70cf6-d962-4ce3-a22c-95b21ac4688b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.034557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70cf6-d962-4ce3-a22c-95b21ac4688b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.040525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 227/469] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:17.045856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70cf6-d962-4ce3-a22c-95b21ac4688b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:17.097607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 243/470] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:17.099673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:17.205192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70cf6-d962-4ce3-a22c-95b21ac4688b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:17.291598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:17.293581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.294530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.295776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.297757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:17.298452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04ad6d-d449-4706-99f5-5801a2d06bfa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:17.300920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:17.313585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:17.332680 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:17.341752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:17.342607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.343029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.343416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.344273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:17.344771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:17.346310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7e55-2f45-4565-b481-f52bd54de3b8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:17.364747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 244/471] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:17.366855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.367359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.367849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.387638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:17.389009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:17.419703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 228/472] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:15:17 2022] POST /identity/v3/users => generated 248 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:17.420667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:17.545057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 245/473] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:17.547532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:17.618215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982936de-db61-4163-9707-3e685ecffd41 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:17.676101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:17.677248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.677691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.678116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.691234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:17.692753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:17.747176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:17.748111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:17.749009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:17.749009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:17.749009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:17.749009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:17.751557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 229/474] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:17.753097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:17.771525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404c790-779b-45e5-97f5-a083614798f1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:17.793782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:17.808056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:17.816285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:17.819966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.819966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.819966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.819966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:17.820259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:17.879912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295be5-d784-4183-a759-866679cc6a86 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:17.927081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 246/475] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:15:17 2022] POST /identity/v3/users => generated 248 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:17.928262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:17.931251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:17.931251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:17.931251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:17.933449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:17.933449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:17.936122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:17.979265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:15:17.979265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 09:15:17.979265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [parameters: {'id': '6c3260950a5f4933be3a8ccf103469ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 09:15:17.979265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() May 27 09:15:18.020433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return ref.to_dict() May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:15:18.021485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:15:18.022434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:15:18.023330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:15:18.024829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:15:18.025673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'id': '6c3260950a5f4933be3a8ccf103469ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:18.026475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 09:15:18.027358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:18.028645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 230/476] 10.222.0.67 () {60 vars in 1131 bytes} [Fri May 27 09:15:17 2022] POST /identity/v3/roles => generated 144 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:18.029551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:18.093326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d88e7-b025-47f0-b269-ddb925574694 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:18.160675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:18.161354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:18.161703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:18.161977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:18.162766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:18.163145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:18.164553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:18.186477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 247/477] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:18.193490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:18.239981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fed77-a313-4e6f-9fb5-2bfdd736ae96 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:18.244841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:18.248454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:18.279351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:18.280167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:18.280484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:18.280886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:18.294788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:18.303810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:18.305006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:15:18.305944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:18.308799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 231/478] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:15:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:18.317044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:18.331642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706826e-bd50-4a54-aa32-20e9752e3e9a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:18.374337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac723349-3503-40bf-ab5c-4ab8d1f2ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:18.375349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac723349-3503-40bf-ab5c-4ab8d1f2ef04 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:18.375868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac723349-3503-40bf-ab5c-4ab8d1f2ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:18.377187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac723349-3503-40bf-ab5c-4ab8d1f2ef04 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:18.378646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac723349-3503-40bf-ab5c-4ab8d1f2ef04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:18.380415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac723349-3503-40bf-ab5c-4ab8d1f2ef04 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:18.434099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d94fd-9bfe-41cb-ae47-775d05547e74 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:18.472825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 248/479] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:15:18 2022] POST /identity/v3/users => generated 249 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:18.485319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:18.486609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:18.487223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:18.487821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:18.489518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:18.490156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:18.493094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ee77-1fda-4b4e-97fe-ee452e797ae1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:18.509324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 232/480] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:19.557403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4908-1897-4fc5-8332-434c9cf0a0c1 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:19.558624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4908-1897-4fc5-8332-434c9cf0a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:19.559123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4908-1897-4fc5-8332-434c9cf0a0c1 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:19.561018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 249/481] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:19.567241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:19.567729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:19.567802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:19.587146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:19.588373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:19.633077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:19.698072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 233/482] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:19.728811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb4908-1897-4fc5-8332-434c9cf0a0c1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:19.872797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:19.889093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb4908-1897-4fc5-8332-434c9cf0a0c1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:19.939600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c79c7-a041-40ac-ba12-b27d6c1690b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:19.941401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c79c7-a041-40ac-ba12-b27d6c1690b3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:19.941898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c79c7-a041-40ac-ba12-b27d6c1690b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:19.942374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c79c7-a041-40ac-ba12-b27d6c1690b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:19.964240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c79c7-a041-40ac-ba12-b27d6c1690b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-007c79c7-a041-40ac-ba12-b27d6c1690b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:19.973335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:19.974336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:19.975157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:19.982104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 250/483] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:19.988966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:20.148548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a6f4-3730-4bdf-9b59-cbb281e7fcf9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:20.211958 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:20.212705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.212994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.213278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.214074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:20.214390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:20.215823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:20.218685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370a7d-7100-4d8f-bf95-d832844e8d5d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.218958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370a7d-7100-4d8f-bf95-d832844e8d5d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.219241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370a7d-7100-4d8f-bf95-d832844e8d5d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.220684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 251/484] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:20.232286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.232542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.232766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.244377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 234/485] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:20.248354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:20.283669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:20.317546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:20.319036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:20.409817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b599-d5de-4d7a-b7d0-4f8135cfb05f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:20.450700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:20.451652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.451944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.452224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.470910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:20.474030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:20.479768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 252/486] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:20.499523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:20.500646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:20.501695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:20.501695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:20.501695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:20.501695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:20.501695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 235/487] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:20.508187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:20.529143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:20.668239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:20.689234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636cdf-f111-4929-8c0a-e1b0c6e66982 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:20.720994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:20.729962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:20.730633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.730918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.731197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.731935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:20.732283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:20.733728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:20.747025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 253/488] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:20.752518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:20.798603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667b1a9-f09a-45d7-b2a7-3900a829dd7b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:20.865239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e3b97-20f9-4b71-bfb0-79cbc442ba8f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:20.905694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:20.905931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:20.906522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.906808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.907090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.907273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:20.907916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:20.908545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:20.916916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:20.918522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:20.927925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:20.945783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:20.957220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:20.958210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:20.959116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:20.960163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:20.961082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:20.961894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:20.965650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 254/489] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:15:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:20.966042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 236/490] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:20.967695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:20.971897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:21.113899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584768f-c6b4-4767-a014-c07ef1509c52 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:21.159455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:21.160154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.160474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.160759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.161927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:21.162246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:21.163931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac008a-0e2b-44a2-85ed-97b73dedc0b2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:21.187501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a02df6-3a22-41fc-9b6c-fc09cbb5ac66 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:21.213246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 255/491] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:15:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:21.214658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6cff-8801-458d-8cbc-dd1031fff584 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.214956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6cff-8801-458d-8cbc-dd1031fff584 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.215232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6cff-8801-458d-8cbc-dd1031fff584 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.222459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 256/492] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:21.222459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb6cff-8801-458d-8cbc-dd1031fff584 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:21.242186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:21.251621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:21.253298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.253783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.254647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.256055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:21.257069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:21.259706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739902f-c658-4755-a4af-d832782e32f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:21.278128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 237/493] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:21.279196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.279710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.280226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.299094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:21.312422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:21.314973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:21.354319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb6cff-8801-458d-8cbc-dd1031fff584 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:21.395908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3ab7c-6a5d-4850-95f8-9d84ca46a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:21.396784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3ab7c-6a5d-4850-95f8-9d84ca46a1df None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.397165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3ab7c-6a5d-4850-95f8-9d84ca46a1df None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.397543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3ab7c-6a5d-4850-95f8-9d84ca46a1df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.461581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 238/494] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:21.463409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:21.557425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3ab7c-6a5d-4850-95f8-9d84ca46a1df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:21.560599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3ab7c-6a5d-4850-95f8-9d84ca46a1df None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:21.594098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e849cf-554d-496f-a52c-5f382c0a9ccb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:21.625700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:21.639217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:21.640925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.641638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.642067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.655927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:21.657439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:21.661570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:21.677591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:21.678533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:21.679370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:21.679370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:21.679370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:21.679370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:21.683622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 239/495] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:21.685778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:21.722389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 257/496] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:21.724630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac3fb-4bfc-4048-9291-12c93376c0bb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.725147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac3fb-4bfc-4048-9291-12c93376c0bb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.725653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac3fb-4bfc-4048-9291-12c93376c0bb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.728378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 258/497] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:21.729342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbac3fb-4bfc-4048-9291-12c93376c0bb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:21.813561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa28ac-829c-43a0-aebc-cc2c3fc7d2c7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:21.853124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbac3fb-4bfc-4048-9291-12c93376c0bb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:21.855979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59ce7-a24a-4ba2-9dd2-cda61cf49fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:21.857363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59ce7-a24a-4ba2-9dd2-cda61cf49fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.857732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59ce7-a24a-4ba2-9dd2-cda61cf49fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.858214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59ce7-a24a-4ba2-9dd2-cda61cf49fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.873147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a59ce7-a24a-4ba2-9dd2-cda61cf49fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d7a59ce7-a24a-4ba2-9dd2-cda61cf49fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:21.881980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:21.883253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:21.884452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 240/498] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:21.885611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6669-4eb8-45cd-800b-444c29ce9e41 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.885611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6669-4eb8-45cd-800b-444c29ce9e41 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.885611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6669-4eb8-45cd-800b-444c29ce9e41 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.892670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 241/499] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:21.892670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6669-4eb8-45cd-800b-444c29ce9e41 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:21.902620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:21.903794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.904300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.905113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.906237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:21.906811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:21.909991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d018-bec3-4064-9d16-f75e7f3a7827 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:21.930026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 259/500] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:21.932561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:21.933066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:21.933572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:21.934955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:21.960984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:21.963063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:21.985171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.006418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6669-4eb8-45cd-800b-444c29ce9e41 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.048981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.049976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.050328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.050717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.054408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 260/501] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:22.055314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.071663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.073239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-51f10c1e-bcb5-4f0d-9844-1946eb4f5ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:22.094169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:22.095363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 242/502] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.098007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.115890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:22.117193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:22.194715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a386f5-fbf9-47bb-b598-591c587d0721 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.203829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 243/503] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:22.204934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.245042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.254072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.255909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.255909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.255909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.256157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:22.256464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.257937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.273441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 261/504] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:22.275116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.291459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.356615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e198b-8d87-4157-a1b6-37eb10f1d1ef None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.396003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.396868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.397148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.397426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.405618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.406226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac703dc-09f7-4db2-99b1-6f962fd0cc4e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.407112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:22.436593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:22.437908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:15:22.438804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:22.439704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 244/505] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:22.441034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.447685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.448523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.448836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.449118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.461024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.462550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:22.492905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:22.494616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:22.496513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:22.496513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:22.496513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:22.496513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:22.496513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 262/506] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:22.497074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.547869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.569681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.572206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c24e-ceca-4e71-a8d4-90eff42179c0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.613873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13042f0-907d-4012-a7a0-bb28615dcf8c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.619621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.620497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.620914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.621300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.622133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:22.622439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.623909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.636368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 245/507] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:22.637412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.666858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.667663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.667958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.668223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.684484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:22.694189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:22.696052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 263/508] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:22.697684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.753354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773d13-e135-44ba-b280-684d0615f0d2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.790298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.791118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.791405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.791678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.799043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.803856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.805356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:22.824509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:22.825878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:22.826721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:22.826721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:22.826721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:22.826721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:22.826721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 246/509] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:22.826721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.832739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba34b3-a41a-4441-95fa-d5d89c2c218f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:22.868063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:22.879946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:22.880761 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:22.881051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:22.881330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:22.882181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:22.882491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:22.883993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:22.905186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 264/510] 10.222.0.67 () {56 vars in 1137 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:22.906057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:22.968970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebc468-2d79-4b38-969f-8f30fc6f9134 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.015237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.015826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.016253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.016655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.017725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:23.018132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.021216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.037420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9204-d82e-45fe-898f-47ec8c13c17f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.042946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 247/511] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:23.044424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.089080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.090074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.090546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.090904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.099280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.101881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.122649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:23.126415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:23.127271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:23.128826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 265/512] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:23.130053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.187905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:23.197982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b5bc-c861-45a4-9c65-1236ca17d417 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.250492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.251204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.251492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.251772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.252618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:23.252972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.254537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.263979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 248/513] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:23.265014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.277768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1181be5-de7a-4711-aa62-c3cab350ae69 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.341568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.342490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.342946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.343450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.344925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:23.345281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.348589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.368159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 266/514] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:23.369678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.396441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2add87-08ba-482b-8984-4db0b4ffab7e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.413380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:23.444027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.445107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.445928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.446398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.514716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:23.518235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250f22-d59c-4b48-a18a-c6ab45a0c93b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.537376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.538812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.579070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.580203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.580725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.581797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.583128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.585950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.650115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 249/515] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:23.650985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.666694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:23.704157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 267/516] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:15:23 2022] POST /identity/v3/users => generated 247 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:23.705730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.796927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb9d9-62a7-451e-8f02-5409cab388a1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.861331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.862433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.862901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.863346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.864804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:23.865329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.866282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f05da-3d3e-403a-b41f-79de8d997a9c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:23.867968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.907679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 250/517] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:23.907679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.918673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:23.919848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:23.920354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:23.920857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:23.939227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:23.941917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:23.964589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:23.966989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:23.969291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:23.969291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:23.969291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:23.969291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:23.969291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 268/518] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:23.969291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:23.985291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:24.038907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:24.097670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3a5e1-1361-404f-bcae-5c7b67908669 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:24.141156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e377f0-208b-49ce-b9d7-4d0197fbcf89 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:24.162930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:24.164342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:24.164870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:24.165525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:24.180604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:24.183416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:24.204301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:24.205626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:24.206230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:24.206725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:24.212895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:24.213807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:15:24.214817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:24.220696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 251/519] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:24.224750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:24.230895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:24.231415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:24.268253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:24.269959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:24.271608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:24.271608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:24.271608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:24.271608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:24.271608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 269/520] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:24.273244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:24.368106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b205e-00c3-4e50-b0ef-fb7e1304d439 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:24.397306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:24.421119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:24.432473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:24.433859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:24.434973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:24.435648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:24.438336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=cd4d716fddeb41d1a697a0f23db35a26) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:24.439594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:24.443554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:24.458819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 252/521] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:24 2022] GET /identity/v3/role_assignments?user.id=cd4d716fddeb41d1a697a0f23db35a26&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:24.460277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:24.460709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83fb5-be87-4662-9918-5df9bc234976 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:24.530155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:24.531829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:24.532746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:24.533549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:24.535764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:24.536697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:24.539675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:24.563445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 270/522] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:24.565553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:24.657353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c9cb-2cf1-40d1-a426-7d217a02d03a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:24.718750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398369ad-66e9-42bd-9f4d-774a0cd1bb9f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:24.727359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:24.729209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:24.730071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:24.730836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:24.732969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:24.733910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:24.736994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:24.753003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:24.761783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:24.762463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:24.762746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:24.763021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:24.764673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:24.769365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:24.773414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:24.786444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 271/523] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:24.787069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:24.821472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 253/524] 10.222.0.67 () {56 vars in 1137 bytes} [Fri May 27 09:15:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:24.823347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:24.956934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:24.973626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9309f-0046-450a-adf0-be96c4421088 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.017996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226c95-7554-404a-a495-221102fa0d46 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.042359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.043752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.044241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.044778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.059624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:25.062821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:25.095370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:25.097279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:25.099129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 272/525] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:25.100262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:25.102987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.104875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.106048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.106907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.128662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:25.132397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:25.169830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:25.171799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:25.173578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:25.181285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 254/526] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:25.181285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:25.194373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:25.324040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eead035-5999-436f-87eb-a678c02b8695 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.393877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.394977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.395472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.395960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.439496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dcdeb-8fd4-4500-87e5-596ec0e1a8ad None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.470351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:25.511467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.513337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.514554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.515309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.517230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:25.517948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:25.522024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:25.557699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:25.560804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:25.561432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 255/527] 10.222.0.67 () {56 vars in 1139 bytes} [Fri May 27 09:15:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:25.563337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:25.631573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:25.713111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 273/528] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:25.714618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:25.733753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a77f9b-bc36-46f8-9087-3e1673f2dc58 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.775048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.776209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.776740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.777220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.778298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:25.778844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:25.780551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:25.795029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 256/529] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:25.796594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:25.833325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:25.910148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a132692-1ad9-4918-8cb4-c3314cb89d60 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.919802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f116d3f-9c2a-4e69-9476-b8a53dadc965 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:25.960185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.961845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.962335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.962842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.976124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:25.977967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:25.979836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:25.981138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:25.981645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:25.982379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:25.998581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:25.999546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:26.000505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:26.000505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:26.000505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:26.000505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:26.003627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 257/530] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:26.004241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:26.005606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:26.104963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:26.123603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe82ac-c169-40f0-80a4-7de5d0b3abac None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:26.125510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:26.130392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:26.168992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2479966-8780-4273-874b-48cea3150abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:26.170150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2479966-8780-4273-874b-48cea3150abe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:26.170663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2479966-8780-4273-874b-48cea3150abe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:26.171161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2479966-8780-4273-874b-48cea3150abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:26.172515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2479966-8780-4273-874b-48cea3150abe None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=7a4af657aef94d1abff7bc9c10264832) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:26.173107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2479966-8780-4273-874b-48cea3150abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:26.175343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2479966-8780-4273-874b-48cea3150abe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:26.182506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 258/531] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:26 2022] GET /identity/v3/role_assignments?user.id=7a4af657aef94d1abff7bc9c10264832&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:26.183888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2479966-8780-4273-874b-48cea3150abe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:26.336069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2479966-8780-4273-874b-48cea3150abe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:26.355361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 274/532] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:26.364357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:26.432546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:26.433703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:26.434211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:26.434649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:26.435683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:26.436242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:26.437962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:26.452777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:26.474969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 259/533] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:26.483281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:26.507308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:26.559812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec1d2-24b3-4998-b1fa-b47c37fb9547 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:26.608899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:26.610134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:26.610629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:26.611070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:26.657199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:26.659840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:26.713074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:26.714091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:26.714942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:26.714942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:26.714942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:26.714942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:26.715661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f47bbe-3256-4d32-8da4-19649bc3b21a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:26.715744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 275/534] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:26.724466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:26.843015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:26.844419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:26.844921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:26.845394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:26.868527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:26.871503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:26.919096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:26.920652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:26.923145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 260/535] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:26.929886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:26.968740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:26.974681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678162c-0f93-4045-af25-9609e90d1b95 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:27.051988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:27.052785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.053029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.053312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.054053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:27.054362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:27.055787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:27.077259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 276/536] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:27.085116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:27.089163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:27.132085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3529b98-7ece-4459-8002-dce71a9c04de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:27.175012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:27.176065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.176603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.177119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.178128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:27.178663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:27.180542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:27.200610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 261/537] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:27.203032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b26fd-f46f-4691-945f-be00c393caa1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:27.203523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:27.291267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:27.292684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.293182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.293687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.311641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:27.313460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f911073f-31dc-47a9-9bf1-b66304dfbf65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:27.333670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:27.334591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:27.335459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:27.336581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 277/538] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:27.337819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d8f68-1e82-44f7-9f89-97cad26da262 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.338008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d8f68-1e82-44f7-9f89-97cad26da262 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.338274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d8f68-1e82-44f7-9f89-97cad26da262 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.339877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 278/539] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:27.344006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d8f68-1e82-44f7-9f89-97cad26da262 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:27.360593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:27.388918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9c78-a39f-4fa7-9151-b8a134d3679b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:27.428979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:27.441806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:27.442891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.443368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.443849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.445417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=bb1b0792dd6a41ba82c5d04a08596bec) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:27.445946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:27.448087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537edd3c-b5b2-462e-8d32-9bd30b413fb0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:27.461871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 262/540] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:27 2022] GET /identity/v3/role_assignments?user.id=bb1b0792dd6a41ba82c5d04a08596bec&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:27.463625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5215a2-6939-4e4f-812a-a7c70774156d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.464045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5215a2-6939-4e4f-812a-a7c70774156d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.464491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5215a2-6939-4e4f-812a-a7c70774156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.486738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0d5215a2-6939-4e4f-812a-a7c70774156d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:27.488682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0d5215a2-6939-4e4f-812a-a7c70774156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:27.512450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d8f68-1e82-44f7-9f89-97cad26da262 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:27.580256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:27.581413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.582044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.582849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.584131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:27.584910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:27.587268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20698b-313f-482d-adb7-a3be21702505 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:27.616382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 263/541] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:27.616382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ea2f-5160-425e-b8d2-2bcf83e80c50 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.616382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ea2f-5160-425e-b8d2-2bcf83e80c50 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.616870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ea2f-5160-425e-b8d2-2bcf83e80c50 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.619643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 264/543] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:27.619817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 279/543] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:27.625088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53ea2f-5160-425e-b8d2-2bcf83e80c50 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:27.625976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.626445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.626857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.646163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:27.647801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:27.764475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 280/544] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:27.767230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:27.771471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:27.833400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53ea2f-5160-425e-b8d2-2bcf83e80c50 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:27.880349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:27.903160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:27.904505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:27.904889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:27.905399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:27.908512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=76f6fdb7d7074ddba6170f110c750489) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:27.909637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:27.914312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:27.929580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 265/545] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:27 2022] GET /identity/v3/role_assignments?user.id=76f6fdb7d7074ddba6170f110c750489&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:27.932058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:28.007426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa317-cae0-448f-ba9e-41be323403f9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:28.127092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:28.131226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:28.132009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:28.132757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:28.157488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:28.179041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:28.180965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:28.182581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 281/546] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:28.192940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:28.226568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41e4ec-49b1-4019-a814-c1fcae1d4036 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:28.308246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:28.309849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:28.310492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:28.311125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:28.325089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:28.349952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:28.367851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4f3ef-b6c0-4592-b9a0-3f6185af7aa4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:28.384375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:28.387015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:28.389139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:28.394172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 266/547] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:28.405410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:28.416463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:28.416463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:28.416463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:28.416463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:28.417313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:28.417500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:28.419064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:28.438234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 282/548] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:28.449425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:28.543811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:28.617974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffba63-d6ca-433e-8cc5-8ee0a74c28d6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:28.655224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:28.656582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:28.657071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:28.657668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:28.658899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:28.659311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:28.661789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:28.675417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2058-fee8-4580-a03f-59f1fc4ea654 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:28.675615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 267/549] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:28.681685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:28.735703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:28.763096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:28.764112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:28.764462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:28.764746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:28.800465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:28.802127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:28.803411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e1637-d36a-44cd-802f-312c2efc1c91 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:28.813386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:28.833973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:28.835026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:28.835922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:28.835922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:28.835922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:28.835922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:28.840540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 283/550] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:28.848895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:28.855385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:28.856637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:28.857145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:28.863384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:28.879538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:28.883005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:28.917291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:28.918252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:28.919125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:28.919125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:28.919125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:28.919125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:28.934011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 268/551] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:28.939235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.094118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18737556-b963-4fe0-b116-eddbed828379 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.108251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8aac-c15a-4388-9715-aeac4685d8b4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.140438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.141475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.141956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.142448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.144018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:29.146267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:29.147967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:29.165906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 269/552] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:29.171889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.196672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:29.198516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.199213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.199503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.199784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.200656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:29.200908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:29.202349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:29.235315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 284/553] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:29.241440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.319047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d225767-c9ea-467f-a609-94206adfcd0a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.348361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:29.382982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.384250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.384819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.385162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.399825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:29.403182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c0b18f4c-6fa8-400f-91be-fe617007cac1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:29.432951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:29.434010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:29.434919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:29.435912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 270/554] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:29.437962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f68d4-1ab8-43c2-9813-b55205fde431 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.438437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f68d4-1ab8-43c2-9813-b55205fde431 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.438946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f68d4-1ab8-43c2-9813-b55205fde431 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.442017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 271/555] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:29.443434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f68d4-1ab8-43c2-9813-b55205fde431 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.482051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dfc24-3da9-4f81-836e-a062f0520927 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.545413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.547040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.547549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.548017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.559138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:29.561612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-41c8aa57-bff6-44bd-8eb3-72429e17b712 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:29.591585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:29.593827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 285/556] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:29.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.597304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.597304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.611917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:29.625553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:29.628449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:29.649787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f68d4-1ab8-43c2-9813-b55205fde431 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.705434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 286/557] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:29.707014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.707715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.708877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.709583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.710148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.711809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:29.712445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:29.715305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:29.738255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:29.750166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 272/558] 10.222.0.67 () {56 vars in 1135 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:29.751546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.823779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51133de-e195-482f-bf07-65ce5b610637 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.869117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.869964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.870257 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.870539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.871558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:29.871990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:29.873630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:29.875259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818628-e389-4825-b9fa-00b484fc3f78 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:29.896551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 287/559] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:29.897584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:29.917054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:29.917936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:29.918229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:29.918566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:29.928928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:29.933513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:29.943020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:29.945377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 273/560] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:29.946427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.007249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.026357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d55267-3f69-401e-bc57-b2509f4523e3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.064802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362b53a-f461-4e10-96f8-4b361cd43ebf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.068819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.069749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.070378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.070865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.103233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.104851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.105145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.105636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.118571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.120115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:30.139516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:30.140515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:30.141406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:30.141406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:30.141406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:30.141406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:30.141406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 274/561] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:30.142189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.159276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.161867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.202238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.259586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7af2-de08-4bfc-a40e-7b4c2881ed1b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.267084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.287312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 288/562] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:30.288771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.297257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.297943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.298228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.298529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.300066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:30.300491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.301823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.311450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 275/563] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:30.312374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.413719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f169ca-545f-4414-9fca-fcaeb5f34d9e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.428409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b41cb-777c-4488-91bf-87738f677b2f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.443653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.459121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.460157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.460477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.460757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.461661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:30.462320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.464071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.466800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.467687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.467974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.468255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.479581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 289/564] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:30.479778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.480900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.481278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3a7c6954-8bf1-4094-990f-84410b6de16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:30.508380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:30.515749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 276/565] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f248-b3b0-44d7-956b-1fcd24a753c9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f248-b3b0-44d7-956b-1fcd24a753c9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f248-b3b0-44d7-956b-1fcd24a753c9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.524182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 277/566] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:30.525259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f248-b3b0-44d7-956b-1fcd24a753c9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.564504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.641728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72c93-fcac-4f9d-8bad-b1e3957c3f69 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.663588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f248-b3b0-44d7-956b-1fcd24a753c9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.696901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.698203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.698753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.699378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.704729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.705652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.706025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.706406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.713917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.715410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.717985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.720802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:30.731157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:30.733099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 278/567] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:30.734654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fe926d6d-e3b7-464b-96c2-098af78ef4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:30.750835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:30.751979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:30.753524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:30.753524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:30.753524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:30.753524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:30.753524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 290/568] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:30.754093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef067c6-ec11-4ad3-aa51-c3b627779fff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.754404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef067c6-ec11-4ad3-aa51-c3b627779fff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.754712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef067c6-ec11-4ad3-aa51-c3b627779fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.768568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.773140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eef067c6-ec11-4ad3-aa51-c3b627779fff None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:30.774359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eef067c6-ec11-4ad3-aa51-c3b627779fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:30.855427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 291/569] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:30.856149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732a50-2ef8-414d-b2a9-2087b3eb9969 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:30.856807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8616-1111-4add-9987-46b4b1f353a3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.857101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8616-1111-4add-9987-46b4b1f353a3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.857378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8616-1111-4add-9987-46b4b1f353a3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.858834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 292/570] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:30.859399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8616-1111-4add-9987-46b4b1f353a3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.901323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:30.911429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:30.912535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:30.913045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:30.913543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:30.914945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:30.915353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:30.918010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:30.938318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 279/571] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:30.940841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:30.981533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8616-1111-4add-9987-46b4b1f353a3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.019344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.019893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.020181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.020486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.021268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:31.021576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.024274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e261-9c56-45b8-8d23-8714a5a39144 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.035623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 293/572] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:31.036965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.037331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.037617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.055591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:31.056837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:31.067832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.083854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f6bf-8482-4672-ac28-264a9b92a59c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.119256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.119926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.120208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.120582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.121310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:31.121613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.122992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.129167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 294/573] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:31.130041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.143461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 280/574] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:31.143461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.154693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.260120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235f9e-d3d8-46b4-8349-b13271de2fe4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.265556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c759c-1654-4223-a689-4d255921db48 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.300878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.301599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.301885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.302170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.313947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:31.314426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.315768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.316049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.316362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:31.322502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:31.323540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:31.325037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 295/575] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:31.325933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.326031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.326102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:31.345623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:31.347142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 281/576] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:31.349121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.353888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.427506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.451554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76db62-8621-4c96-b831-8462ee11d0a8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.458415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f5cf8-a58c-4003-a0cf-e586dfced98b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.495563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.497192 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.497338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.497707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.498049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.498185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/cd4d716fddeb41d1a697a0f23db35a26/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.498338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.498594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.507295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.508900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:31.524460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:31.531687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:15:31.533340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:31.533937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=cd4d716fddeb41d1a697a0f23db35a26, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.534046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 282/577] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:31.534046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.534283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.595258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.635503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f93ae-bc2d-4362-ad1f-5bfc1e96d1cf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.642140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 296/578] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:15:31 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/cd4d716fddeb41d1a697a0f23db35a26/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:31.643517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.705326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.706538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.707000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.707385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.726441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:31.740834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:31.742684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:31.744313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 283/579] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:31.746709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.838050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7c793-bcf0-464d-a99d-f5ee8b7d2c56 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.877035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.887950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.888673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.888961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.889243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.890006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:31.890382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.891796 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.901472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 297/580] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:31.901685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331823-5dff-4dfc-a4dd-1000ab9a1be5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:31.902195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:31.929949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:31.941105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:31.941835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:31.942124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:31.942460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:31.943241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:31.943552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:31.945062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:31.958571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 284/581] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:31.964157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:32.130130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fecd6-e0f7-4b4e-930c-733c7b50f1aa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:32.193563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eca60c-d4a1-4b17-b67f-3745b571a51c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:32.199637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:32.200374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:32.200672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:32.200953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:32.201850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:32.202163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:32.203697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:32.232833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 298/582] 10.222.0.67 () {56 vars in 1137 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:32.232833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:32.262115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:32.263290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:32.263587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:32.264238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:32.265678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:32.266209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:32.267980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:32.286670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 285/583] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:32.288444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:32.306287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:32.349433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:32.410654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8ccee-46a0-4c80-8ba1-d8caef025f0a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:32.457561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:32.457841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f953b-4ffb-4ebb-9e34-63fffd5d1859 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:32.458381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:32.458660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:32.459000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:32.471413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:32.473048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:32.494439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:32.496372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:32.497422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:32.497422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:32.497422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:32.497422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:32.497422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 299/584] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:32.497422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:32.527093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:32.527791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:32.528088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:32.528401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:32.529268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=7e8dcad979224353841afc735e1e7b9d) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:32.529588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:32.531098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:32.537792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 286/585] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:32 2022] GET /identity/v3/role_assignments?user.id=7e8dcad979224353841afc735e1e7b9d&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:32.538676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:32.682406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6c47d-086b-4839-bba2-31aa7d7b28d7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:32.688636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:32.710816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde20638-f687-4a41-b37b-eab078114943 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:32.724229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:32.752240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:32.754135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:32.754617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:32.755106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:32.757718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:32.758963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:32.759374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:32.760038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:32.770408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:32.772217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:32.781368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:32.784792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:32.792904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:32.793897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:32.794819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:32.794819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:32.794819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:32.794819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:32.802308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 287/586] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:32.803737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:32.834128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:32.835954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:32.837803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:32.837803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:32.837803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:32.837803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:32.837803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 300/587] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:32.837803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:33.029156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ed1d3-9491-45b3-a776-8ba209a80bfa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:33.048032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7abcd-92c0-4178-8ec6-23807a24e0d7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:33.112873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:33.114008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:33.114781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:33.115140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:33.115601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:33.115919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:33.116483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:33.117305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:33.117475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:33.117867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:33.119445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:33.120270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:33.120453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:33.123853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:33.146741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 301/588] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:33.148368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:33.152573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 288/589] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:33.156385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:33.173465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:33.214332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:33.358799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ad92-2f9e-4873-b03b-98b26f64d45a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:33.360481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279093-c56d-419e-ac97-133c63dc37f4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:33.423765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:33.425369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:33.426239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:33.426576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:33.427247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:33.428097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:33.428719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:33.429296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:33.429684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:33.430482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:33.433429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:33.444985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:33.448748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:33.459553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 302/590] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:33.461078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:33.479806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:33.481663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:15:33.483491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:33.488032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 289/591] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:33.490227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:33.614453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:33.648658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:33.682201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c6360-0578-4a97-831a-4315f7b554cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:33.686527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d2b1-3a81-4e31-9645-7ac28f043dea None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:33.763001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:33.764661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:33.764850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:33.765315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:33.765787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:33.767200 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:33.768114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:33.768917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:33.782019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:33.785173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:33.785376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:33.788954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:33.818168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:33.821911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 303/592] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:33.823084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:33.827911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:33.829797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:33.831833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:33.836036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 290/593] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:33.837964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.050338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575aa63-7e29-45dc-bc3b-db187e320863 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.059316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ecf9f-6722-4c28-a16b-33ab56252275 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.090152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.090863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.091129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.091411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.092260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:34.092604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.094064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:34.111598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:34.116711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 291/594] 10.222.0.67 () {56 vars in 1137 bytes} [Fri May 27 09:15:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:34.117905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.125139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:34.129370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.130052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.130333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.130610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.131460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:34.131770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.133362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae603b-7a31-440b-bdda-e8d7a0909122 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:34.161758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 304/595] 10.222.0.67 () {56 vars in 1139 bytes} [Fri May 27 09:15:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:34.161758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2858dd-594c-4b0c-9945-2e92fc466bf6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.161758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2858dd-594c-4b0c-9945-2e92fc466bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.161758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2858dd-594c-4b0c-9945-2e92fc466bf6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.161758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 305/596] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:34.161758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2858dd-594c-4b0c-9945-2e92fc466bf6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.282813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92146-6719-42ef-be6d-f29b4d0b9071 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.331542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.332113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.332418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.332698 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.333760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:34.334210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.335815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:34.358182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 292/597] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:34.358182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.388384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2858dd-594c-4b0c-9945-2e92fc466bf6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.436017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.437554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.438039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.438487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.452475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.454439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:34.478082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5c30a929-30ef-4086-9741-943e378960bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:34.480757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:34.482433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:34.484209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:34.484209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:34.484209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:34.484209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:34.484209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 306/598] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:34.485876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.485876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.486362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.508955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:34.510468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:34.557618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:34.567892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb416e5-9855-4033-ac96-dc4b86e18415 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.601899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 307/599] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:34.603006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.645484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.646689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.647101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.647504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.668846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.671988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:34.707666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:34.709696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:34.718108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:34.718108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:34.718108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:34.718108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:34.718108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 293/600] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:34.718108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.752664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e4bc-776b-442f-ab86-62cec0a5584e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.797137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.798442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.798930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.799936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/7a4af657aef94d1abff7bc9c10264832/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.818904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=7a4af657aef94d1abff7bc9c10264832, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.820798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:34.899183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 308/601] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:15:34 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/7a4af657aef94d1abff7bc9c10264832/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:34.900475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:34.913204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd10-738d-4d83-ae82-1608c42888ab None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:34.941881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:34.953206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:34.989041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:34.990379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:34.991070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:34.991587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:34.993179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:34.993629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:34.996688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:35.026096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 294/602] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:35.026096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.092939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345e4fa-e7f2-4302-a460-b935f0525ab3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.155279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.156923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.157442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.157942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.173364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cb51d-0a38-499b-8a51-d77838763127 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.174387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:35.184085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:35.185168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:35.186022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 309/603] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:35.186740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.231050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.231753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.232038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.232347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.233110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:35.233429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:35.235344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47807-ac9a-4036-9a60-0dde01e41f29 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:35.248936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 295/604] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:35.250345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4408-229d-4677-b3b2-5ce3490b4054 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.250631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4408-229d-4677-b3b2-5ce3490b4054 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.250913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4408-229d-4677-b3b2-5ce3490b4054 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.256683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 296/605] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:35.257640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4408-229d-4677-b3b2-5ce3490b4054 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.312593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:35.341743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:35.367832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a7420-e621-4487-b3c2-370fa87c875f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.426041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4408-229d-4677-b3b2-5ce3490b4054 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.436281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.437679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.438192 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.439024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.451491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:35.454268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:35.470873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.471630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.471915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.472199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.473024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:35.473338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:35.474759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ffbcbdfa-7919-4ef9-9c30-666e2a8df1eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:35.485249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:35.487344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 310/606] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.490788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.493463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.495389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 297/607] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:35.495766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.526643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:35.527913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:35.644567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 311/608] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:35.647680 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.658117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:35.670287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a1fce-b0a9-4cc4-9c25-1f3bec3ad0e1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.744310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.746015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.746510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.747383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.758039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:35.759728 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:35.769438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:35.776727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:35.787383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 298/609] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:35.789582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.837246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557df60-5129-4adb-be41-71f9d733e8fa None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.879185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.879857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.880152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.880465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:35.881255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:35.881567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:35.883085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:35.900466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 312/610] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:35.900466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:35.938524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadbab7-d20d-4030-86dd-e646a45d616b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:35.980754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:35.982102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:35.982723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:35.983182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.001802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.004126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.028448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73749b9-7ed5-4ada-a61f-2257c4ba50a9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:36.035686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:36.036800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:36.037708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:36.037708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:36.037708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:36.037708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:36.042904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 299/611] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:36.042904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.051621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:36.077635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:36.090088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.092095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.092825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.093493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.110821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:36.119839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:36.121229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 313/612] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:36.122361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.188013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d2c7-fbc9-4808-9156-bb67fc944463 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.246375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.247436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.247936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.248466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.249940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:36.250509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.253447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.259127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073365-1f37-4ac7-afbe-f0916f268ba7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.276374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 300/613] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:36.277873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.314452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.315936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.316222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.316538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/bb1b0792dd6a41ba82c5d04a08596bec/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.335685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=bb1b0792dd6a41ba82c5d04a08596bec, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.337530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.399548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:36.450573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 314/614] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:15:36 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/bb1b0792dd6a41ba82c5d04a08596bec/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:36.451469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.464761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f2ec7-eddd-4c03-bb91-9bebbce2df49 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.521546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:36.522275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.524010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.524647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.525206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.526138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:36.526905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.529394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.548693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 301/615] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:36.550556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.614815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e31d-7ad1-49d4-b576-362da35f53d9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.663973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.664717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.665011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.665267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.666032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:36.666341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.667951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.678922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 315/616] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:36.679829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.706268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f13d-5c06-4c76-98d1-de056221d831 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.748141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:36.761810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.763799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.763799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.763799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/76f6fdb7d7074ddba6170f110c750489/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.798733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=76f6fdb7d7074ddba6170f110c750489, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.800792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.847524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904edf6-d712-4fec-bf9a-bb2a472a6e98 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:36.850543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:36.872498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 302/617] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:15:36 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/76f6fdb7d7074ddba6170f110c750489/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:36.874245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:36.920133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:36.921721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:36.922241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:36.922751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:36.939077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:36.942307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:36.972784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:36.974143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:36.976532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 316/618] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:15:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:36.981291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:37.046489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3728893-08a9-4d8e-be3c-7b5915ac76e3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:37.098083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:37.099712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:37.100219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:37.101110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:37.114906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:37.120514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:37.147145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:37.148116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:37.149040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:37.149040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:37.149040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:37.149040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:37.155532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 303/619] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:37.160299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:37.200947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:37.242037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de70a0-11ee-4b17-961b-feb2909395fb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:37.284883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:37.285944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:37.286491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:37.286983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:37.288030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:37.288577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:37.290260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:37.326963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 317/620] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:15:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:37.335325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbd88-e121-4a3a-9559-39c4f2a57351 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:37.337124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:37.391100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:37.412006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:37.413138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:37.413672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:37.414128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:37.415053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:37.415765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:37.418237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:37.448516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 304/621] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:37.457928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:37.614776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8b71d-2e4b-47a4-8869-097d4a686edb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:37.630057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516547-b364-4250-8655-4a8a06e38178 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:37.633018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:37.727847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:37.729158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:37.729667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:37.730161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:37.730626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:37.732247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:37.733188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:37.733995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:37.773586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:37.776924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:37.822928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:37.824781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:37.826548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:37.836567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 305/622] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:37.841630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:37.956374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:37.957878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:37.982901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:38.047047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e259-72b8-486c-91fa-f867068b0440 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:38.087276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:38.087960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.088246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.088581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.089615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:38.089791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:38.091136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da84c-2e9b-444c-9ab7-c0fdd062283a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:38.118890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 306/624] 10.222.0.67 () {56 vars in 1135 bytes} [Fri May 27 09:15:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:38.118890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9d1ce-317f-4fd0-9dc9-dd77a7c3c5e0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.118890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9d1ce-317f-4fd0-9dc9-dd77a7c3c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.118890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9d1ce-317f-4fd0-9dc9-dd77a7c3c5e0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.119545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 307/625] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:38.119766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 318/625] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:38.119873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9d1ce-317f-4fd0-9dc9-dd77a7c3c5e0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:38.122067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:38.134474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:38.260946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9d1ce-317f-4fd0-9dc9-dd77a7c3c5e0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:38.281915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdec5b-9287-43a8-b5fe-7fb5f3fabd1a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:38.326605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:38.328417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:38.329746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.330220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.331232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.349825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:38.352404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:38.355115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:38.357218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.357992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.358733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.380111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:38.383250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3b7f68d0-51dd-4362-972c-59914ad7284c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:38.385988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:38.387663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:38.389397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:38.389397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:38.389397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:38.389397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:38.393347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 308/626] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:38.395787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.396267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.396768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:38.424982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:38.426332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:38.427871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:38.427871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:38.427871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:38.427871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:38.430442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:38.435990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:38.436506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 319/627] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:38.438308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:38.532750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:38.560447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 309/628] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:38.563176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:38.653394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003903-5d06-4b51-85a2-38eebfc4436f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:38.717021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:38.718391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.719197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.719851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.721599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:38.722346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:38.724998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:38.748153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 320/629] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:38.750241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:38.783732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ad79-6c39-4237-b2eb-8fd1f6284d00 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:38.809421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:38.848204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:38.849601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:38.850193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:38.850774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:38.852261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:38.852919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:38.855750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:38.881282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 310/630] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:38.881282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:38.962245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ea29-92c6-4f9d-bee7-def38c266cfd None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:38.984017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.026881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.028576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.029167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.029747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.053122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:39.071572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:39.073740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:39.075846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:39.080540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 321/631] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:39.082322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.098051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af54fba-a2cf-4e26-b041-5c2a0ee51f5a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.144693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.145618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.145905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.146302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.154835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.156638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:39.172439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:39.175120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 311/632] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:39.177401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.214541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.224404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca98b5-5ae2-428b-a2e5-e935f4697de9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.274059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.274852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.275134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.275407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.282766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.284290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d0ffc37f-5233-4c44-86c8-e43881b4a2cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:39.299493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:39.300531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:39.301467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:39.305732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 322/633] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:39.307181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82a1c-426b-475f-85a5-1da5f6b40698 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.307469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82a1c-426b-475f-85a5-1da5f6b40698 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.307752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82a1c-426b-475f-85a5-1da5f6b40698 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.309117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 323/634] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:39.309817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82a1c-426b-475f-85a5-1da5f6b40698 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.323835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace041-ffa0-4157-b1e2-164dc83edd47 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.334720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.364633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.365349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.365725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.366068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.367007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:39.367521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.369307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.382888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 312/635] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:39.383850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.469172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82a1c-426b-475f-85a5-1da5f6b40698 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.493555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97646a7c-165b-4f36-ab35-5a99fcb68ed8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.529105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.529434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.529961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.530242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.530516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.531300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:39.531605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.531868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.532506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.533093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b178fdb-4a52-4567-98fb-b8a685bdeff3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.533950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.535665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:39.536503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.539291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.551923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 313/636] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:39.551923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.551923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.551923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.567716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 324/637] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:39.567716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.567967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:39.568435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:39.592418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.595086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.644299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 314/638] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:39.645583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.720210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea2378-3d63-473e-be2d-70741fde2e2e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.760627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.761641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.762030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.762417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.772805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0516b-3d85-47d8-b2c1-f4fb9baeba2a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:39.774129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.775715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:39.796791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:39.797876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:39.798847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:39.798847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:39.798847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:39.798847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:39.798847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 325/639] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:39.799376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.824756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:39.826032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:39.826032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:39.826430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:39.827273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=cd4d716fddeb41d1a697a0f23db35a26) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:39.827635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:39.829547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:39.844817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 315/640] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/role_assignments?user.id=cd4d716fddeb41d1a697a0f23db35a26&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:39.844817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:39.875506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.896004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:39.968366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d439d3-fb37-496e-b19d-488cc6bae89c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:40.003330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615c830-7e57-4e3a-bb19-705fba89590f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:40.023943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:40.025007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:40.025364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:40.025712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/7e8dcad979224353841afc735e1e7b9d/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:40.043145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=7e8dcad979224353841afc735e1e7b9d, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:40.044860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:40.062330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:40.063932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:40.064472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:40.065533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:40.082361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:40.090306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:40.093103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 316/641] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:40.094133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:40.120356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 326/642] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:15:39 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/7e8dcad979224353841afc735e1e7b9d/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:40.121612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:40.275316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:40.290448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100c9bd-71fe-40f9-8436-b6e299c9ec39 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:40.306625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373d293-5013-4073-9d02-d0bedcd3e982 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:40.318179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:40.350682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:40.352220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:40.352711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:40.353151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:40.354862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:40.355355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:40.357356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:40.370277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 327/643] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:40.377984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:40.387919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:40.388920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:40.389391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:40.389869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:40.391207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:40.392274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:40.395602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:40.419715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 317/644] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:40.433868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:40.665484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf21b83-bb4d-45f0-ad07-342041158af6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:40.722335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd881-8ebc-46cc-9df7-6d42dbaa66d8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:40.740870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:40.742744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:40.743381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:40.743996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:40.759851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:40.763523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:40.767427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:40.769044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:40.770141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:40.770600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:40.782457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:40.784802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:40.797209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:40.798423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:15:40.799571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:40.807256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:40.808195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:40.809118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:40.809118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:40.809118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:40.809118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:40.809348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 318/645] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:40.811068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 328/646] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:40.812225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:40.821644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:40.823634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:40.896744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:40.964451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6d817-44b0-45a9-8fb1-826b4ce42ee8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.007433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.008425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.008875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.009291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.010287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:41.010742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.012370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa24b6-b04b-4860-b8e8-71233cea2c62 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.032555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 319/647] 10.222.0.67 () {56 vars in 1137 bytes} [Fri May 27 09:15:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:41.034148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50709-d22b-46e0-8c77-deecab8f00fc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.034929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a108-e41c-47cc-a25e-fff2b72aec39 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.035362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a108-e41c-47cc-a25e-fff2b72aec39 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.035780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a108-e41c-47cc-a25e-fff2b72aec39 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.037264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 320/648] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:41.041411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a108-e41c-47cc-a25e-fff2b72aec39 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.103185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.104353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.104858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.105371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.106773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:41.107325 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.109926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f22e-88c1-49a5-bf3a-ae394b6b683f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.115926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.133898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 329/649] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:41.136308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.136989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.137496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.162898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:41.164099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:41.164914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a108-e41c-47cc-a25e-fff2b72aec39 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.220226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.220724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.221547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.221827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.252715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 330/650] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:41.253698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.290366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.322614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.324506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.381119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12ee0-4fde-4bd7-8744-83aefbbc1fde None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.396433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.419271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.420084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.420409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.420693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.428969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.430456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.445143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 321/651] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:41.446354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:41.446936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:41.447877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:41.448886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 331/652] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:41.450227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.534204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.557408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d2a92-c31e-447d-92cb-464916bbee47 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.563905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8115a-7cda-419d-b787-798f2ae593f2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.595318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.596630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.596914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.597192 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.606425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.607619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.608099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.608628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.608804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.610255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.621781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:41.629502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:41.630507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:41.631399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:41.631399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:41.631399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:41.631399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:41.631399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 332/653] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:41.632097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:41.633836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:41.634826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:41.635685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:41.638786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 322/654] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:41.639968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.671385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.751780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f9efc-60b3-4d94-b5aa-f71f7a00c53c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.760612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedd034-1771-4e48-a948-19b6219a7681 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.786489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.792965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.793682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.793969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.794252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.795556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:41.795714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.797718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.807051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:41.808154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:41.808707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:41.809247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:41.810315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:41.810925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:41.812712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:41.820284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 333/655] 10.222.0.67 () {56 vars in 1137 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:41.821221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.828842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 323/656] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:41.830102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:41.940082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:41.957789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327349-18de-4801-9efa-318892fb0ea7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:41.971736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ca7e0-4057-472b-9647-c976e1c77713 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.005070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.005749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.006027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.006305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.007061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:42.007368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.008839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.023670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 334/657] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:42.024923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.027937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.028990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.029896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.030390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.094778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:42.126266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.129695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.151205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90292adb-035d-4e13-9e88-68be9c8216e4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.188554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.189426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.190327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.190609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.198603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.200984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:42.216515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:42.217489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:42.218397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 335/658] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:42.219434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.230159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:42.254974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 324/659] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:42.256234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.335588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5ca6-38e8-4387-83ff-8f394cd73624 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.348745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:42.373039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91ee8-3975-4f15-9547-83cad855f222 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.377294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.377525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.377784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.378087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.390838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.392863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:42.413347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:42.414323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:42.415224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:42.415224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:42.415224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:42.415224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:42.418558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.419374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 336/660] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:42.419785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.420271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.420397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.421262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.422350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:42.422897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.425495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.439776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 325/661] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:42.441178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.492097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:42.544381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd389a-8472-4348-9f91-ccae259e542e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.587543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18130f-1d73-4cd4-9440-956f03bf4169 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.589046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.589967 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.590356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.590732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.604882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.606456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:42.629943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:42.632008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:42.634053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:42.634053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:42.634053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:42.634053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:42.634053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 337/662] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:42.634586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.654651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:42.657740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.659876 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.660702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.661481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.663387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:42.664246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.667162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.700931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 326/663] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:42.702980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.764040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c11c-198b-43ba-90cf-7af07358261e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.812958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:42.813665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:42.813950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:42.814231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:42.815976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=7a4af657aef94d1abff7bc9c10264832) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:42.816310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:42.817817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:42.826300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 338/664] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/role_assignments?user.id=7a4af657aef94d1abff7bc9c10264832&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:42.827188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:42.928737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:42.959035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af54a52-267d-4d0a-8422-ff77079a6d29 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.960554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d48a-480c-4559-9e11-a3c6433d3edb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:42.964124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:43.011312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.012402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.012670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.012972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.026748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:43.028585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:43.036520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.038081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.038609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.039134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.040127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:43.040700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:43.042518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909470-fcc5-4e16-8ba9-50108434f032 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6631885d-12de-4e01-96a9-6e2c1e79a83d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:43.047911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:43.049057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:43.050016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 339/665] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:43.051257 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49137-5b92-4d8b-b365-9fe4b6f61b8a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.051611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49137-5b92-4d8b-b365-9fe4b6f61b8a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.051892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49137-5b92-4d8b-b365-9fe4b6f61b8a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.056438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 340/666] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:43.058261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e49137-5b92-4d8b-b365-9fe4b6f61b8a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:43.065396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 327/667] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:43.067335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.067929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.068457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.092046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:43.093636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:43.198360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 328/668] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:43.199678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:43.206332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e49137-5b92-4d8b-b365-9fe4b6f61b8a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:43.251724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.251724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.252045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.252286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.253575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:43.253575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:43.255317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69408a93-cafd-4b59-ab4e-f5131634bfce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:43.263988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:43.280975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 341/669] 10.222.0.67 () {56 vars in 1139 bytes} [Fri May 27 09:15:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:43.283724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11e6f2-15c1-4778-b444-abe094c8d2d9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.284143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11e6f2-15c1-4778-b444-abe094c8d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.284594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11e6f2-15c1-4778-b444-abe094c8d2d9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.286975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 342/670] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:43.288085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11e6f2-15c1-4778-b444-abe094c8d2d9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:43.347714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:43.361362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d8b61-0824-44d2-a3aa-faa00a3c71c8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:43.419249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.420386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.421106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.421555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.433441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:43.435882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:43.460726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:43.461677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:43.462601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 329/671] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:43.463854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:43.473141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11e6f2-15c1-4778-b444-abe094c8d2d9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:43.514607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece3200-ce88-4f87-be08-507b1748f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.515773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3200-ce88-4f87-be08-507b1748f643 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.516263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3200-ce88-4f87-be08-507b1748f643 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.516754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3200-ce88-4f87-be08-507b1748f643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.531385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece3200-ce88-4f87-be08-507b1748f643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7ece3200-ce88-4f87-be08-507b1748f643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:43.539952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:43.541928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 343/672] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:43.544845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.548375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.548375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.563766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:43.565119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:43.627792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:43.642286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8512-547e-425c-956f-938acfc6e75e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:43.656782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 344/673] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:43.659258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:43.705986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.706830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.707242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.707652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.742468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:43.818977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c4b6-018f-4070-92d2-c90b71146bbd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:43.834580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:43.837444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:43.865667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:43.866528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:43.867014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:43.867473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:43.868479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:43.868926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:43.870730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:43.886707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 345/674] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:43.894021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:43.965736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:44.040025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbcc8-248c-41eb-9fab-8fa9bdd4b5f1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.043539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 330/675] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:44.044997 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.092396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:44.093342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:44.093768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:44.094180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:44.095429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:44.095964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:44.097870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:44.109841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 346/676] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:44.116289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.150843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:44.215520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb245-5271-45a2-960f-924dbfd23fd6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.276831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:44.278414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:44.278936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:44.279440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:44.285965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176e7b-c0fe-4e5c-b925-2d82ec594dfa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.298610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:44.307299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:44.323607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:44.325242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:44.326396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 331/677] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:44.327885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.340954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:44.341803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:44.342217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:44.342634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:44.343670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=bb1b0792dd6a41ba82c5d04a08596bec) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:44.344191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:44.346152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:44.353474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 347/678] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/role_assignments?user.id=bb1b0792dd6a41ba82c5d04a08596bec&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:44.354072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.484929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e2413-9690-405e-93b7-9db63d78eda8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.505719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:44.537294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:44.538477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:44.538859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:44.539364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:44.561571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:44.563352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:44.584315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee16e6-5ae1-41c1-8b5c-2cc20d9125c2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:44.585506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:44.587353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:44.589132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:44.589132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:44.589132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:44.589132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:44.589132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 332/679] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:44.589651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.655316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:44.656286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:44.656672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:44.657004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:44.674915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:44.676477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:44.698157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:44.699903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:44.702533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:44.702533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:44.702533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:44.702533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:44.704516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 348/680] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:44.705594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.755309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:44.786936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922cf43-57f2-41c0-82ff-dbc18f98952a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.853437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:44.853986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:44.854344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:44.854698 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:44.855548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:44.855942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:44.857499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:44.868739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 333/681] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:44.869734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:44.909313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a575b-6e91-4d3f-a096-b3a2aa056b1b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:44.952776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:45.000261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.001436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.002002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.003003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.004345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:45.004903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.008235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.031312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec3127-c1d8-4ec5-90c3-a6b0993b68a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:45.038963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 349/682] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:45.038963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:45.118787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.120243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.121002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.121620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.123456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:45.124222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.128735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.158814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 334/683] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:45.164484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:45.253313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:45.267372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34018-235d-42c8-8e12-b4ffdf8daab0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:45.335831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.337403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.338025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.338639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.341381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:45.357473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.361120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.372706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9cf82-8404-4721-baa8-ea9b67e2d797 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:45.397344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:45.399364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:45.401243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:45.401243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:45.401243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:45.401243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:45.406915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 350/684] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:45.408696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:45.453231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.455689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.456524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.457409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.471280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.474559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:45.503391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:45.505203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:45.507026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:45.511457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 335/685] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:45.521379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:45.608472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4f78-1fa1-414b-96f1-6bf734207160 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:45.671055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.672409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.672915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.673390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.679341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:45.690491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.693323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.713181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf18041-e209-4baa-95a4-409e1aefb18c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:45.721842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:45.722900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:45.723923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:45.732592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 351/686] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:45.733377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:45.777239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.778546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.779024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.779493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.780988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:45.782023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.783977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8915b-19fe-455c-8154-676d22c79eaa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.809590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 336/687] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:45.809590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757aa0-eea2-4168-9dab-5ee35956e867 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.809590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757aa0-eea2-4168-9dab-5ee35956e867 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.809590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757aa0-eea2-4168-9dab-5ee35956e867 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.814595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 337/688] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:45.814595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757aa0-eea2-4168-9dab-5ee35956e867 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:45.830629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:45.907617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a52d7-0b09-4226-a0c0-8b21f29138c4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:45.957428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:45.958441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:45.958930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:45.959423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:45.960965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:45.961527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:45.964286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:45.993089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 352/689] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:45.993089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:46.006323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757aa0-eea2-4168-9dab-5ee35956e867 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:46.066235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:46.073944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:46.075479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:46.075923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:46.076391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:46.077886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:46.078376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:46.080947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bec032-5106-402f-b730-2a30303b0fa2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:46.123611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 338/690] 10.222.0.67 () {56 vars in 1135 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:46.126084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:46.126606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:46.127655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:46.134728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab297a-ae9a-4c82-892d-0e6e11baad44 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:46.160933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:46.162960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:46.181993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:46.183052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:46.183373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:46.183656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:46.193713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:46.195252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:46.213528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:46.215273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 353/691] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:15:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:46.217685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:46.292071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:46.314165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 339/692] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:46.315883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:46.402705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6af2-69d0-4178-920d-ccdf7fe32d35 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:46.433210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:46.459339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:46.460081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:46.460401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:46.460712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:46.461623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=76f6fdb7d7074ddba6170f110c750489) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:46.462107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:46.465874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:46.472407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 354/693] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:46 2022] GET /identity/v3/role_assignments?user.id=76f6fdb7d7074ddba6170f110c750489&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:46.473922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:46.521445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031de2-a95f-42eb-b524-41cd3ed79312 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:46.602753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:46.605005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:46.605805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:46.606939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:46.694851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53fbb9-8b7b-4cfe-bbae-c2563497eafa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:46.762969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:46.764173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:46.766112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:46.766686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:46.767176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:46.769689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:46.770442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:46.772195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:46.782682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:46.786035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:46.804617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 355/694] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:15:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:46.806694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:46.890726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:46.991596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 340/695] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:46.993905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:47.013906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d36088-3f5f-486a-8fff-af167eceb777 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:47.093435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:47.096053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:47.096579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:47.097069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:47.122061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:47.125449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:47.168757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:47.170487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:47.173896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:47.173896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:47.173896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:47.173896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:47.173896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 356/696] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:47.174901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:47.197496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:47.215915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e30ad4-e042-48f9-bd50-0a5b9bc9688c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:47.296037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:47.297622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:47.298434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:47.299905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:47.395933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:47.420011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81c3b-2335-4686-ae99-d155fa06a2a6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:47.442183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:47.445123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:47.485032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:47.486339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:47.486819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:47.487288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:47.510839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:47.514807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:47.553377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:47.555117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:47.556821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:47.556821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:47.556821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:47.556821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:47.560550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 357/697] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:47.562686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:47.645941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:47.665419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 341/698] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:47.668184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:47.710186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f9cc7-c064-44e0-8639-a95054a1cfd7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:47.751505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:47.753647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:47.754181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:47.754657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:47.755652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:47.756176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:47.757823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:47.773485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 358/699] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:47.774837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:47.778540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:47.853870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ccbab-def0-4211-98f9-0e8e6f5143f1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:47.894484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:47.895531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:47.896018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:47.896613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:47.897608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:47.898138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:47.900061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:47.924411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 342/700] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:47.925709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:48.006408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0a2-50fc-4233-888b-1a92212a1df2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:48.025597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:48.059472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:48.061665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.062145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.062626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.076892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:48.078857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:48.098434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:48.099459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:48.100473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:48.100473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:48.100473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:48.100473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:48.103097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 359/701] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:48.104520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:48.109408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12d7aa-5d15-49f7-b705-797016bfbe26 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:48.174693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:48.181041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19873c60-90c4-49b3-8c52-f8e0b65e02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:48.182309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873c60-90c4-49b3-8c52-f8e0b65e02f5 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.182828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873c60-90c4-49b3-8c52-f8e0b65e02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.183357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19873c60-90c4-49b3-8c52-f8e0b65e02f5 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.184779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19873c60-90c4-49b3-8c52-f8e0b65e02f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:48.187915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19873c60-90c4-49b3-8c52-f8e0b65e02f5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:48.226364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091132b2-34a6-4966-a2a2-e2dcadaa04ed None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:48.269718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:48.270753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.271121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.271454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.279800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:48.281403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:48.298389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:48.300742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:48.303656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:48.310622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 360/702] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:48.310622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:48.327260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 343/703] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:15:47 2022] POST /identity/v3/users => generated 254 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:48.327260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b961b-c17f-4089-9bc0-b86dc38044cf None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.327260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b961b-c17f-4089-9bc0-b86dc38044cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.327260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b961b-c17f-4089-9bc0-b86dc38044cf None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.328845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 344/704] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:48.330386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b961b-c17f-4089-9bc0-b86dc38044cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:48.542670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba4ce8-c676-474b-83b2-b949c04a059c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:48.543781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b961b-c17f-4089-9bc0-b86dc38044cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:48.563005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:48.578582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:48.588131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:48.588890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.589180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.589498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.590992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:48.590992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:48.592355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b60ab5-dcd6-4d17-9592-f257a7af4c17 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:48.610117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 361/705] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:48.616357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.616357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.616357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.631447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:48.633798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.633798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.633798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.635188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:48.635594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:48.635757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:48.636862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:48.641257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:48.671751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 345/706] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:48.672487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:48.790993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 362/707] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:48.792652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:48.869172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078190-a5fb-4493-a1bb-9675701cb29d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:48.939358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:48.941395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:48.942262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:48.943092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:48.957293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:48.960288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:48.986058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:48.988174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:48.989811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:48.993902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 346/708] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:48.995766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:49.049407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:49.065509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcb94-bc3e-43a4-8789-ec9543c24c0a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:49.072687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:49.136181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600a377-0420-4e69-b06d-2881ffdd330a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:49.155518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:49.158607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:49.159382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:49.160070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:49.162886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=7e8dcad979224353841afc735e1e7b9d) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:49.164018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:49.168849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:49.179007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:49.180012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:49.180446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:49.180828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:49.181605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:49.183105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:49.187704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 363/709] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:48 2022] GET /identity/v3/role_assignments?user.id=7e8dcad979224353841afc735e1e7b9d&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:49.190513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:49.200025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:49.202183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:49.204183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 347/710] 10.222.0.67 () {56 vars in 1129 bytes} [Fri May 27 09:15:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:49.212701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:49.447677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:49.465232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c4b5-6a30-4780-a77c-cd8b3450db53 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:49.475805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fca80-7b1e-4908-a884-ff0babdc46ce None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:49.536312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:49.537550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:49.538232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:49.538706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:49.539719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:49.540400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:49.542302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:49.543608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:49.544701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:49.545215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:49.545983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:49.547327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:49.547874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:49.551221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:49.562739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 348/711] 10.222.0.67 () {56 vars in 1124 bytes} [Fri May 27 09:15:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:49.563511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 364/712] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:49.569674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:49.571764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:49.633950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:49.711209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40f700-ef69-409c-886d-9828f7e9478b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:49.755326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:49.756074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:49.756382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:49.756670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:49.757730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=cd4d716fddeb41d1a697a0f23db35a26) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:49.758049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:49.761148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ebbae-33ad-427f-832c-28340cfaf88f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:49.764415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5af5-c4d9-409a-8767-7c0d96095895 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:49.772604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 349/713] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:49 2022] GET /identity/v3/role_assignments?user.id=cd4d716fddeb41d1a697a0f23db35a26&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:49.816264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:49.817433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:49.817985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:49.818508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:49.819515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:49.820068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:49.821869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c38bf6-f592-4ffc-bd17-9e046f05dd05 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:49.829760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 365/714] 10.222.0.67 () {56 vars in 1124 bytes} [Fri May 27 09:15:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:50.476621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90297501-7c4b-48bd-8907-485aed96d243 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:50.477677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90297501-7c4b-48bd-8907-485aed96d243 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:50.477995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90297501-7c4b-48bd-8907-485aed96d243 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:50.479637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 350/715] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:50.489729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:50.490672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:50.491423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:50.519353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:50.521932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:50.638528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 366/716] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:50.674053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90297501-7c4b-48bd-8907-485aed96d243 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:50.705522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:50.836125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90297501-7c4b-48bd-8907-485aed96d243 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:50.895748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:50.897013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:50.897508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:50.897989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:50.899046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:50.900684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:50.917697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:50.918801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:15:50.919784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:50.923089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 351/717] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:50 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:50.937277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:50.983940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:51.102031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21434-ff36-4a7a-9f6d-bb9f1441d855 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:51.143168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:51.143868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:51.144150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:51.144466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:51.145200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:51.145506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:51.146956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4fbf6-f329-4810-b7be-8cfdb5fc9da8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:51.152655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 367/718] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:15:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:51.159051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:51.280820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:51.308356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07691a49-ea40-4042-ba25-fb902b403617 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:51.369914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:51.370959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:51.371465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:51.371961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:51.372938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:51.373457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:51.375074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47ae25-d234-4762-a898-18140f0a7139 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:51.386084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 352/719] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:15:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:51.564023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39970b5a-4abe-4a62-b6b9-f69f3a7ae1d8 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:51.564633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39970b5a-4abe-4a62-b6b9-f69f3a7ae1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:51.564633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39970b5a-4abe-4a62-b6b9-f69f3a7ae1d8 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:51.566394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 368/720] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:51.572952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:51.573521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:51.573521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:51.599166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:51.600468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:51.704070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 353/721] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:51.730059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39970b5a-4abe-4a62-b6b9-f69f3a7ae1d8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:51.831313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:51.857912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39970b5a-4abe-4a62-b6b9-f69f3a7ae1d8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:51.909880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:51.910708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:51.910991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:51.911265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:51.931678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:51.939983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:51.941059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:51.941909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 369/722] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:51.953500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:52.092853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:52.117472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf98ca-119c-4e92-8ee7-5b6a90300923 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:52.173102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:52.173864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.174151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.174433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.175213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:52.175525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:52.176960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683dec-e9c7-45fe-b969-887cebcf00d5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:52.188623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 354/723] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:52.194762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:52.277159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95770cb6-f376-4980-ab53-7ddd343fd70b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.277501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95770cb6-f376-4980-ab53-7ddd343fd70b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.277936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95770cb6-f376-4980-ab53-7ddd343fd70b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.280476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 355/724] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:15:52.290294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.290649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.290975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.318330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:52.319569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:52.339542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b16a-fab7-4739-9c9c-9491c38552f5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:52.413233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 356/725] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:52.417575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:52.418408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.418692 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.418971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.433929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:52.435456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:52.443389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:52.452157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:52.484662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:52.486624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:52.486624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:52.486624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:52.486624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:52.487147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 370/726] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:52.495190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:52.612716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:52.629482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2ffa4-24c5-461f-82ce-a3d8f5e3978d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:52.671458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:52.672054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.672363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.672652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.673473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:52.674297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:52.676405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:52.692815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 371/727] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:52.695228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73141-583a-4238-8e6d-e6a5668ce6cb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:52.700375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:52.817083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:52.829315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27743e1-1452-40f8-ae6d-c4c53e6c705d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:52.846498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:52.847749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.848286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.848804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.871320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:52.872368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:52.872663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:52.872944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:52.882505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:52.884615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:52.897066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:52.905739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:52.913625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:52.914694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:52.915343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:52.916206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:15:52.918244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:52.919526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 357/728] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:52.919671 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 372/729] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:15:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:15:52.921974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:52.922463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.063170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6761-0b0f-46fc-9be8-d60161fe1782 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:53.089308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:53.089655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ad416-9102-440d-91f9-1915d6112085 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:53.110489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:53.111587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.112110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.112770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.113899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:53.114450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:53.116145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc013a8-6f96-4179-bbaa-6be6cc9158c0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:53.131574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:53.132351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 373/730] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:53.134868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9bb10-5683-414f-8394-fd7fcc7102a4 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.135438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9bb10-5683-414f-8394-fd7fcc7102a4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.135821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:53.136206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9bb10-5683-414f-8394-fd7fcc7102a4 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.136544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.136831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.137110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.137973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:53.138286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:53.143640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455036db-6eb3-4aa3-ad2b-3363e1bb7bb4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:53.144083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 374/731] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:53.145306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9bb10-5683-414f-8394-fd7fcc7102a4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.164152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 358/732] 10.222.0.67 () {56 vars in 1149 bytes} [Fri May 27 09:15:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:53.166057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.167742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.168361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.188017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:53.189768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:53.274916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 359/733] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:53.277534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.285388 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9bb10-5683-414f-8394-fd7fcc7102a4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:53.342892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:53.344465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.345047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.345653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.360682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:53.362932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-03a28fdb-534a-467f-a477-9840f58a0ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:53.385798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:53.386864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:53.388002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:53.388002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:53.388002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:53.388002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:53.391818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 375/734] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:53.393474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276003-8d13-4aa5-b916-7d1dd278608b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.393768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276003-8d13-4aa5-b916-7d1dd278608b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.394059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276003-8d13-4aa5-b916-7d1dd278608b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.395664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 376/735] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:53.396503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276003-8d13-4aa5-b916-7d1dd278608b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.406245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c59f-3c67-4ba1-9575-381c98d183b6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:53.433723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:53.434549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:53.452979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc443d-b58c-4762-beee-463f09d0dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:53.453912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc443d-b58c-4762-beee-463f09d0dc03 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.454348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc443d-b58c-4762-beee-463f09d0dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.455452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc443d-b58c-4762-beee-463f09d0dc03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.517718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276003-8d13-4aa5-b916-7d1dd278608b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:53.542931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc443d-b58c-4762-beee-463f09d0dc03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:53.544885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc443d-b58c-4762-beee-463f09d0dc03 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:53.557885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:53.558693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.558977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.559258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.571742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:15:53.579722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:53.581504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:15:53.582550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:53.586261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 377/736] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:53.587197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.680664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 360/737] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:15:53.683237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.683808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.684348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.712693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:53.713967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:53.719662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:53.730847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:53.734624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4f090-fb4f-4109-9b02-e8085455049d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:53.775288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:53.775965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:53.776251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:53.776723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:53.777299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:53.777610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:53.779055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:53.795824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 378/738] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:53.797702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.807703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 361/739] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:53.808716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:53.931573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92daa-bc42-4dd6-84bf-443b5046841b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.032713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ce5b2-c57b-49f3-a2aa-8e487135d601 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.035964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.037334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.038754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.039225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.040690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:54.041207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.043625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.064864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 379/740] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:54.064864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.092168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:54.094416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.096220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.096726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.097178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.113469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.115397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:54.135061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:54.136723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:54.138438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:54.138438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:54.138438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:54.138438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:54.138438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 362/741] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:54.138438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.145275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:54.226554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca0ecc-35d3-415f-ba9e-74b9367ee6d4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.273462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.275321 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.276116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.276925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.277829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bb190-e758-4590-b5f9-68266b669b99 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.292083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.295656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:54.321168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:54.322247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 380/742] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:15:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:54.329249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.332895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.333799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.334193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.334628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.335583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.337487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.416914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:54.443405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce340-da36-49b9-a712-58f09552df88 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.461679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 363/743] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:15:54 2022] POST /identity/v3/services => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:54.462925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.489887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.490822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.491561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.492381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.506395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.507923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:54.530299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:54.532299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:54.534326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:54.534326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:54.534326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:54.534326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:54.534326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 381/744] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:54.534866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.563449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:54.617004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99960f-80c6-4bd9-b6c3-8cf189e15848 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.661608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.662406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.662692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.662985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.663702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:54.664011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.665433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3adc7-fe7d-442f-be94-a798d640f5fd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.682520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09326f-9360-4fca-a57f-92a5f49ef3a1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.682732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 364/745] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:54.688204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585c22-e166-4ce1-805f-a108c02ebcae None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.688815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585c22-e166-4ce1-805f-a108c02ebcae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.689250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585c22-e166-4ce1-805f-a108c02ebcae None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.690776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 365/746] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:54.691588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585c22-e166-4ce1-805f-a108c02ebcae None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.718230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:54.737051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.737760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.738023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.738292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.739132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:54.739461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.740923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.769550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 382/747] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:15:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:54.770914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:54.841350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585c22-e166-4ce1-805f-a108c02ebcae None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.867076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:54.879421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.880790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.880790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.880790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.881378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:54.881684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.883059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a105766-aa1b-42af-bb88-5fc7764676c6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:54.900648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 366/748] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:54.901971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.902267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.902540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.921506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:54.922821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:54.937842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb2e82-0b10-4907-a537-3aecec5e2982 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:54.985399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:54.987241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:54.987537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:54.987813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:54.996082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:54.997642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:55.013766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:55.014795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 383/749] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:55.016201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.037873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 367/750] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:15:55.038931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.095758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:55.164498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf5354-97a6-4111-87d0-ff59948c8434 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.184112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:55.211069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa50ad-d2e1-4c63-8359-86d1916836be None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.211445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:55.212184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:55.212525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:55.212806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:55.223399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:55.224975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:15:55.244622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:55.245655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:55.246605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 368/751] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:55.247197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.276474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:55.277620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:55.278185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:55.278612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:55.292080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:55.293987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:55.316013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:55.317239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:55.318170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:55.318170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:55.318170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:55.318170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:55.318393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 384/752] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:55.319451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.398280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b79e2e-38f7-460b-8ec1-43e58c23e902 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.450361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:55.450562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:55.452139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:55.452486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:55.452735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:55.453527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:55.454235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:55.455898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.460557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14d9f9-61ea-4662-8501-1fb675694e3f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.469380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 369/753] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:55.470520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.508124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:55.526067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:55.528705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:55.529641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:55.530758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:55.532364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:55.536741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.611138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 385/754] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:15:55 2022] POST /identity/v3/services => generated 240 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:15:55.611138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.636353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43783e-dc1f-499e-9725-f12289803485 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.735791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:55.737482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:55.738042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:55.738536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:55.740231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:55.740844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:55.743566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.784922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 370/755] 10.222.0.67 () {56 vars in 1135 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:55.786718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.801374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845716ee-3686-4b72-9144-3c31afe79eec None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.840884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:55.841906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:55.842188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:55.842468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:55.843805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:55.844120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:55.846494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:55.862769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 386/756] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:55.863717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:55.881774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:55.966151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:55.988637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6efd7-dff9-4eac-a835-9b510da1aa80 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:55.993548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcea31-df65-4a08-8d0a-69a1133d0455 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:56.052170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:56.052878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:56.053163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:56.053550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:56.054515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=28369b07e3cf45fa90ca15d52c45e4ee) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:56.054832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:56.056495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:56.058158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:56.059282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:56.059783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:56.060275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:56.063799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 371/757] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/role_assignments?user.id=28369b07e3cf45fa90ca15d52c45e4ee&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:56.065667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:56.203170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:56.206672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:56.240445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:56.326030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028d8ad-5eed-464b-b725-91da82c5a86b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:56.414343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 387/758] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:15:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:15:56.423541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:56.424420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:56.424715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:56.424993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:56.425094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:56.436014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:56.437531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:56.455237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:56.456181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:56.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 372/759] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:56.465607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:56.483496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:56.629934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8f37-f4ea-4cf9-b4e6-a306463a8f89 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:56.664348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419347-25d8-4505-ac22-cf3e7e5d84a4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:56.712986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:56.714754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:56.715973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:56.716513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:56.719208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:56.720646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:56.723050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:56.726579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:56.777545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 373/760] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:56.784570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:56.793117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:56.794505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:56.795001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:56.795781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:56.841420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:56.844425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:15:56.909367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:56.910310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:56.911332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:15:56.911332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:15:56.911332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:15:56.911332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:56.919601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 388/761] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:56.923582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:56.996764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:57.089004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c49d-3690-4097-8449-0d490461cdef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:57.175079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567ed95-d5e1-4c9e-ade1-ad310bdfab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:57.176605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567ed95-d5e1-4c9e-ade1-ad310bdfab1f None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:57.177255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567ed95-d5e1-4c9e-ade1-ad310bdfab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:57.177890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567ed95-d5e1-4c9e-ade1-ad310bdfab1f None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/cd4d716fddeb41d1a697a0f23db35a26/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:57.184108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c9c0b-aeea-47cd-9125-e0cb40881ec5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:57.187123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567ed95-d5e1-4c9e-ade1-ad310bdfab1f None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=cd4d716fddeb41d1a697a0f23db35a26, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:57.189939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567ed95-d5e1-4c9e-ade1-ad310bdfab1f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:57.226276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:57.227007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:57.227296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:57.227580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:57.228893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:57.228893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:57.231393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:57.244705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 389/762] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:57.253167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:57.288543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:57.304498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 374/763] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:15:56 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/cd4d716fddeb41d1a697a0f23db35a26/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:15:57.499473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c3ef-4982-4b1b-8084-005b04273f8e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:57.557866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:57.558693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:57.558979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:57.559268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:57.567854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:57.569426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:57.587781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9260-8bff-46ff-92bb-48e64789c8a2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:57.588925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9260-8bff-46ff-92bb-48e64789c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:57.589805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9260-8bff-46ff-92bb-48e64789c8a2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:57.593636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 375/764] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-370b0fc5-0fc6-41e9-956b-ed01c7ef3f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:15:57.598716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:57.600541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:57.602349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 390/765] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:57.612272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf9260-8bff-46ff-92bb-48e64789c8a2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:57.623395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:57.623714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:57.624029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:57.649305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:57.650548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:57.801702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 391/766] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 27 09:15:57.862741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf9260-8bff-46ff-92bb-48e64789c8a2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:57.868401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:57.919346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:57.948218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:57.969543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:57.971264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:57.972072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:57.972854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:57.976092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:57.981416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:57.984674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:58.022849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 376/767] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:58.033523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:58.127857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4dc4-c7cc-4cc5-9bfb-df1c6996a09b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:58.199237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:58.201261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:58.202084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:58.202864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:58.204569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:58.207613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:58.237578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:58.238608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:15:58.239448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:15:58.244992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 392/768] 10.222.0.67 () {56 vars in 1129 bytes} [Fri May 27 09:15:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:58.252079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:58.370449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b89f1-10ef-4170-9581-0ac90d63cc3f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:58.418502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:58.457382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77524412-4d11-4d62-b042-a1448a96432c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:58.476771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:58.477449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:58.477740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:58.478006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:58.478848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=7e8dcad979224353841afc735e1e7b9d) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:58.479165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:58.480696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:58.502855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 377/769] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:15:58 2022] GET /identity/v3/role_assignments?user.id=7e8dcad979224353841afc735e1e7b9d&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:58.525369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:58.526574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:58.527105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:58.527567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:58.529019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:58.530651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:58.534200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:58.544166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 393/770] 10.222.0.67 () {56 vars in 1124 bytes} [Fri May 27 09:15:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:58.553855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:58.672460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:58.787769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec5472-aa1f-42e9-b7b3-919fab1cb1dd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:58.854787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:58.855945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:58.856503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:58.856974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:58.858199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:58.858758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:58.861468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad482a-9566-4949-aba1-0307d8df9e99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:58.871624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 378/771] 10.222.0.67 () {56 vars in 1124 bytes} [Fri May 27 09:15:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:58.881497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:59.044237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39a25-bdf7-445a-add4-f945d8eab58f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.044741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39a25-bdf7-445a-add4-f945d8eab58f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.044990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39a25-bdf7-445a-add4-f945d8eab58f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.047324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 379/772] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:15:59.057091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198ad0a-468c-4423-8047-8238d986850a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.057881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198ad0a-468c-4423-8047-8238d986850a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.058583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198ad0a-468c-4423-8047-8238d986850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.065169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ed763-efa9-48c2-bb1a-b47ae625536c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:59.077260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c198ad0a-468c-4423-8047-8238d986850a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:15:59.078867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c198ad0a-468c-4423-8047-8238d986850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:15:59.114517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:59.115790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.116086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.116391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.117253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] RBAC: Adding query filter params (interface=public, service_id=d4a5957612f548d7952037372e90d744, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:59.117571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:59.119148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:59.129368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 394/773] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:15:58 2022] GET /identity/v3/endpoints?service_id=d4a5957612f548d7952037372e90d744&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:59.134841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:59.148303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:59.220893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 380/774] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:15:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:15:59.264280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198ad0a-468c-4423-8047-8238d986850a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:59.332530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468796c-4370-4df4-9ae1-3b7d69aa871c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:59.377759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:59.378453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.378744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.379025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.379937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:59.381310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:59.395705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 395/775] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:15:59 2022] GET /identity/v3/services => generated 772 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:15:59.404827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:59.528940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198ad0a-468c-4423-8047-8238d986850a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:59.603704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:59.604575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.605000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.605353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.606046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:59.607573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:15:59.641337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:15:59.642987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:15:59.643831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:15:59.645239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 381/776] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:15:59 2022] GET /identity/v3/services/network => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:15:59.653555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:59.770548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:15:59.809693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac0813-df62-4d06-a803-91b087ac42d4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:15:59.856410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:15:59.857479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.857994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.858473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.859454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:15:59.859989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:15:59.861737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0046699-f4e4-4fcd-97fe-6712e62390a5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:15:59.872603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 396/777] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:15:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:15:59.874438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:15:59.993182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518368-5a92-4432-a154-cc0f9fed2b9b None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:15:59.994347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518368-5a92-4432-a154-cc0f9fed2b9b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:15:59.994830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d518368-5a92-4432-a154-cc0f9fed2b9b None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:15:59.996474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 397/778] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:00.003226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d735-99d4-47a8-8fbb-961180820ead None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.003534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d735-99d4-47a8-8fbb-961180820ead None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.003782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d735-99d4-47a8-8fbb-961180820ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.034419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2383d735-99d4-47a8-8fbb-961180820ead None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:00.035663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2383d735-99d4-47a8-8fbb-961180820ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:00.131856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6aab7-0534-4f6f-a918-02a5f760e348 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.153749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:00.167085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 398/779] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:00.170439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff877e0-54fa-4fa5-a038-e03b79f11634 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.171506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff877e0-54fa-4fa5-a038-e03b79f11634 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.172017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff877e0-54fa-4fa5-a038-e03b79f11634 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.176556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 399/780] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:00.183664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.184422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.185137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.186752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.187839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.188411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.189473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.191172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:00.192025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:00.194266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:00.211657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 382/781] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:15:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:00.213094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.215738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:00.218314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:00.328830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:00.344530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 400/782] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:00.346075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.381463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28247b-ae89-45b6-8576-f5a7a1d3acd1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.422125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.422835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.423171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.424588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.438267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:00.446297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:00.447774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 383/783] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:00.449847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.487224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:00.550865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2ce2b-593f-44b4-bde3-07bd7cf855ab None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.556851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba236b-e069-4344-a5d0-2efcb8e58ebf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.592537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.593494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.593872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.594237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.608541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:00.617647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:00.619738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:16:00.621562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:00.624484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 384/784] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:00.625469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.627100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.628206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.629067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.630278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.632240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] RBAC: Adding query filter params (interface=public, service_id=1e9915451ad8421186bfa77ee9432c57, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:00.633106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:00.636106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:00.647202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 401/785] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/endpoints?service_id=1e9915451ad8421186bfa77ee9432c57&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:00.648931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.740878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:00.746793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578473-c7c3-40e2-a389-e15394515d34 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.766364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:00.786517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.787210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.788212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.788212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.788520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:00.788834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:00.790221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:00.800355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 385/786] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:00.801919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.860017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1f035-e3a7-47d6-9c26-64cf128b0ff9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.915685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425796-47c5-4b15-92b8-af61d0cce15c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:00.918218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.919350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.919848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.920621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.921611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:00.922129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:00.923948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:00.934512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 402/787] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:00.935777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:00.959948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:00.960729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:00.961011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:00.961286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:00.961971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:00.963473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:00.976501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 386/788] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:00.977714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.023076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:01.057281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee953-9c50-44bf-9ca5-d489e5486240 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.081894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:01.097851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.099154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.099852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.100369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.113281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.115272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:01.135983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:01.137000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:01.138064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:01.138064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:01.138064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:01.138064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:01.140828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 403/789] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:01.147447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.177637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8db229-07dc-4db8-aefd-1f1888b612aa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.262208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.263050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.263310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.263584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.278505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875bb2-bf98-4728-818d-ae2d3e130e08 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.287772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.288854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:01.329208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:01.330948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:01.331909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:01.331909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:01.331909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:01.331909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:01.335835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 387/790] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:01.336961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.337478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.338062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.338501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.338933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.339855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:01.340368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.341971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.372841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 404/791] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:01.379254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.434153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:01.448670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:01.464472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddba2b6-0000-4aeb-b553-434f313070e2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.510545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.511239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.511525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.511806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.512624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:01.512944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.514376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65612bfe-0183-401f-87de-0bc4714de171 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.527973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 388/792] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:01.537773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03e6e-314d-4eaf-b4ff-dd8f1c61d36c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.538170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03e6e-314d-4eaf-b4ff-dd8f1c61d36c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.538439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03e6e-314d-4eaf-b4ff-dd8f1c61d36c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.539887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 389/793] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:01.541552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03e6e-314d-4eaf-b4ff-dd8f1c61d36c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.568180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c04363-6890-4ff1-80a8-25204eb80f53 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.631915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.633285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.633721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.634052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.652733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.655850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-0dad690b-a5a3-4889-8c12-938234f67ad2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:01.684572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:01.686464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:01.688369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:01.693416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 405/794] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:01.696446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.697520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.698212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.715262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03e6e-314d-4eaf-b4ff-dd8f1c61d36c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.733144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:01.736476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:01.755953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.756498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.756783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.757062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.759580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:01.765974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.767502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:01.783895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:01.786022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:01.788067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:01.790007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 390/795] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:01.791028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.897997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 406/796] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:01.900080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:01.911822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868995ab-b865-41c0-aca3-a5513f6a7223 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:01.952202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:01.956346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:01.957191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:01.957513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:01.957864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:01.958808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:01.959236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:01.961010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:01.983251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 391/797] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:01.988092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.050973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:02.108606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611277a-7251-4a7d-a4d1-52d7aac9d860 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.117385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d976cd-cdab-4751-aaf3-4332255423ff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.149880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.150513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.150804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.151074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.164279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:02.172819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:02.175447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 392/798] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:02.177314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.192994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.193689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.194135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.194432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.195389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:02.195706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:02.197233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:02.221409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 407/799] 10.222.0.67 () {56 vars in 1149 bytes} [Fri May 27 09:16:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:02.222307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.357554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:02.381254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb09f7-f861-4b7f-88d3-17120b0256cb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.409830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91969ac8-9bca-4c8d-a566-66a82a6537af None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.427378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.428075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.428400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.428679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.429568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:02.429885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:02.431387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:02.442982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 408/800] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:02.444422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.452394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:02.476157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.476868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.477356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.477646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.581188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:02.583795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:02.593300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524581-a44f-4af0-962c-dc905dfb7caf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.634048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.634860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.635248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.635540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.648503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:02.650106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:02.653298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:02.679169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:02.680148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:02.681116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:02.681116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:02.681116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:02.681116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:02.681116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 409/801] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:02.682849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.750054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 393/802] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:16:02.755392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.779063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:02.849412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d4917-c04c-4b65-8037-219a11d9910a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.901358 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.902978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.903612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.904317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.915504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70889a9-233f-4563-8444-cdcaa406f1c7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:02.924606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:02.927471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:02.955390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:02.956552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:02.957676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:02.957676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:02.957676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:02.957676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:02.959725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 410/803] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:02.960990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:02.964865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:02.966585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:02.966585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:02.966585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:02.967476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:02.967897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:02.969495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:02.988418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 394/804] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:02.988418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.029230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:03.096337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6772-7733-45d4-9c92-0f2fb3bf7ab3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.101016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:03.138821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9593-eb58-4393-84a7-798bf6d49e81 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.145656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.147062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.147508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.147931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.165664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.168235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.180317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.181392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.181699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.182093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.182959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:03.183388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.184955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:03.193567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:03.194702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:03.195834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:03.195834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:03.195834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:03.195834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:03.202745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 411/805] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:03.202745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.207642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 395/806] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:03.209587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.336946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:03.343186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce0a9c-a6a7-417a-ba3c-e62064dae635 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.346617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b2520-2f7f-45cb-96b1-6287b26c8757 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.384900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.385978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.386266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.386546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.393723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:03.396889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.399066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.399926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.400257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.400619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.401121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.401355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:03.401667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.405503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.416308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 396/807] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:03.417132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-51898bf2-a4f2-4dcf-ba2e-526164c72353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:03.445157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:03.446228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:03.447130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:03.453803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 412/808] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:03.453803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42429cd1-f7a6-4a2a-a16f-456fab515298 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.453803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42429cd1-f7a6-4a2a-a16f-456fab515298 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.453803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42429cd1-f7a6-4a2a-a16f-456fab515298 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.454927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 413/809] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:03.456395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42429cd1-f7a6-4a2a-a16f-456fab515298 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.571509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3616f2-3a1d-4432-86cc-054fd64e75a9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.618295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42429cd1-f7a6-4a2a-a16f-456fab515298 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.642932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.644306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.644827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.645323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.661027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.663827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.664182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.665057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.665361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.665654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.675714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.677160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:03.693096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:03.694499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:16:03.702816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-30edb4e9-3ad5-4d3b-ace7-2f1e36864f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:03.704854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:03.709624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:03.711057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:03.712035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 397/810] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:03.712035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.712359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 414/811] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:03.712359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.712359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.712359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.733464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:03.735370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:03.761752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:03.807308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:03.851951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 415/812] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:03.852935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:03.890877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fec3f-3a84-432f-9446-f4c8df85c86a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:03.945004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:03.946057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:03.946570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:03.947071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:03.948693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:03.949184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:03.952001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:03.982310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 398/813] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:03.982310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:04.015672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ad5f2-9553-40c4-9a79-407c8ef0bcdb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.063189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.064449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.064907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.065367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.066768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:04.067285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.069166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.083726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 416/814] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:04.085116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:04.102905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:04.151044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698fb8-b99f-4db3-8327-ee7dc654ea9b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.174920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:04.200681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.201358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.201703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.202045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.202962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:04.203336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.204928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.228235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbe3f5-86c0-435a-9123-aa567ceabe67 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.244611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 399/815] 10.222.0.67 () {56 vars in 1135 bytes} [Fri May 27 09:16:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:04.244611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:04.274710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.275984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.276489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.276951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.278098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.280532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fbc307d9-b499-46ee-981c-3518afe69927 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:04.303474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:04.305305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:04.306939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 417/816] 10.222.0.67 () {56 vars in 1129 bytes} [Fri May 27 09:16:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:04.308583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abef6f-673b-43f7-85f6-5f4591dbb88c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.309627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abef6f-673b-43f7-85f6-5f4591dbb88c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.309627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abef6f-673b-43f7-85f6-5f4591dbb88c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.316396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 418/817] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:04.316396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abef6f-673b-43f7-85f6-5f4591dbb88c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:04.397127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:04.431904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f34c4-b9c6-4418-ae4f-2ff6c26bbd30 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.432612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abef6f-673b-43f7-85f6-5f4591dbb88c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.474666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.475409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.475753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.476035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.476917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=cd4d716fddeb41d1a697a0f23db35a26) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:04.477232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.478700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.484788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.485715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.485998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.486278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/28369b07e3cf45fa90ca15d52c45e4ee/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.498986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 419/818] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:04 2022] GET /identity/v3/role_assignments?user.id=cd4d716fddeb41d1a697a0f23db35a26&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:04.498986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:04.526857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=28369b07e3cf45fa90ca15d52c45e4ee, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.529510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.608142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 400/819] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:16:04 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/28369b07e3cf45fa90ca15d52c45e4ee/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:16:04.610238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:04.662165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:04.737777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c97a-d99c-42a5-ac0e-7b52c452d625 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.827292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.829980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.830867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.831637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.833307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc145-dad6-472d-b687-3e897cd4b764 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:04.838385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:04.861165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.864608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8de20954-cb7f-4eae-a341-2b1ec0a030a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:04.904975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:04.906996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 420/820] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.909275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.917429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:04.919122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:04.919850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:04.921393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:04.922821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:04.927890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:04.927890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:04.934273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:04.935291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 401/821] 10.222.0.67 () {56 vars in 1124 bytes} [Fri May 27 09:16:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:04.936531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:04.937976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.109031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 421/822] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:05.110800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.111700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:05.134137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12cfb-e447-43ea-8522-d59b45030bb4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:05.185863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:05.187360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:05.188053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:05.188813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:05.190394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:05.191176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:05.194148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:05.216782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 402/823] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:05.218762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.259376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3047f-d673-4e9a-8e00-a7b564327ee6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:05.285881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:05.315677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:05.316587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:05.316974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:05.317351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:05.318193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:05.318601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:05.320348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:05.331814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 422/824] 10.222.0.67 () {56 vars in 1124 bytes} [Fri May 27 09:16:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:05.333538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.425085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b13d7b-4c26-4b8a-bb91-494717b2da6c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:05.458401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a624b-f6bd-4b87-bebb-dd08a003f02d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:05.490217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:05.492033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:05.492776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:05.493617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:05.495199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:05.498012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:05.499594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:05.500552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:05.500942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:05.501351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:05.509840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:05.511661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:05.524146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:05.526329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:16:05.528055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:05.530688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:05.532350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:05.534528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:05.536481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 423/825] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:05.537050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.537296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 403/826] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:05 2022] GET /identity/v3/services/network => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:05.548618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.565559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:05.626738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:05.699318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f335259-745a-4fe3-89a5-3ae92778c1ce None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:05.725927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb6dd-cdc9-4b77-87c6-2d54e30fe7f1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:05.746441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:05.747410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:05.747847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:05.748277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:05.749564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:05.750581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:05.753127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:05.772076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 404/827] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:05.774011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.780416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:05.781698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:05.782350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:05.782936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:05.784419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:05.786699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:05.863123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:05.892532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 424/828] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:05.892532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:05.927979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36452b1a-a94e-405b-9d61-f7c6db67f980 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:06.025313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:06.026309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:06.026789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:06.027197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:06.028079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:06.030513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:06.032250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:06.044416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 405/829] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:06.053065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:06.133589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:06.145065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8dab-540b-4bb0-b23d-54c59a156a24 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:06.201043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:06.202353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:06.203887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:06.205016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/7e8dcad979224353841afc735e1e7b9d/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:06.207742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=7e8dcad979224353841afc735e1e7b9d, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:06.209299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:06.266228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5c97-29f3-435f-a6fa-cdc8bc52afdd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:06.297486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 425/830] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:16:05 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/7e8dcad979224353841afc735e1e7b9d/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:16:06.324183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:06.337669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:06.338907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:06.339711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:06.340529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:06.341964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:06.342785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:06.345839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8abd7b-5e66-41c5-895a-acfcefcdff9e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:06.354435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 406/831] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:06.363799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:06.569377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20a5e-d8e9-4bd5-aa8a-699651e0196d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:06.646088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405df2-b1b5-4714-a9ce-236744193330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:06.647876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405df2-b1b5-4714-a9ce-236744193330 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:06.648798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405df2-b1b5-4714-a9ce-236744193330 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:06.649644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405df2-b1b5-4714-a9ce-236744193330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:06.651421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405df2-b1b5-4714-a9ce-236744193330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:06.654701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405df2-b1b5-4714-a9ce-236744193330 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:06.770044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 426/832] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:07.471037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fad5-1eb9-4ee0-8c4c-3976420d16d5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:07.471791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fad5-1eb9-4ee0-8c4c-3976420d16d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:07.471791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fad5-1eb9-4ee0-8c4c-3976420d16d5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:07.473423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 407/833] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:07.479310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:07.480026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:07.480026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:07.499918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:07.501237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:07.501404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cacbb-ebd2-450b-b232-b376542a60d2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:07.501776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cacbb-ebd2-450b-b232-b376542a60d2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:07.502268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cacbb-ebd2-450b-b232-b376542a60d2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:07.505148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 408/834] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:07.512456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:07.512953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:07.513432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:07.514301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:07.541688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:07.543259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:07.627098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 427/835] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:07.663059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:07.663369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 409/836] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:07.685546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:07.800116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703a0e3-52cd-44c9-8c73-b874a7f4f87a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:07.826072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:07.838722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:07.849964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:07.849964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:07.849964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:07.849964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:07.849964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:07.854261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa9a98-8beb-4f16-b1cb-e164ab2486ca None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:07.855826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:07.858168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:07.860184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 410/837] 10.222.0.67 () {56 vars in 1132 bytes} [Fri May 27 09:16:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:07.863275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:07.927092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:07.928919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:07.929819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:07.930642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:07.948411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:07.957365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:07.967265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:07.968302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:16:07.970394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:07.971078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 428/838] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:07.978767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:08.004981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a797-9ff0-4ca8-a525-789e3159d1fc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:08.042843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:08.043519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:08.043801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:08.044077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:08.045106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:08.045423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:08.046949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:08.056808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 411/839] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:08.058374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:08.119708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:08.179337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930194-572a-4a14-b48b-7a62d2aecede None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:08.180450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73995-f419-4550-868a-596801ac13f6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:08.220871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:08.221827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:08.222283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:08.222731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:08.223626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:08.224103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:08.225877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:08.236675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 412/840] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:08.255248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:08.256504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:08.257038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:08.257559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:08.259195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:08.259752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:08.262506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:08.280780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 429/841] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:08.286058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:08.418297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23679-99a9-4d47-92f9-dbe6f0e30ed6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:08.436423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:08.462403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:08.463619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:08.464170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:08.464831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:08.479922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:08.482229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:08.503034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:08.504019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:08.504971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:08.504971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:08.504971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:08.504971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:08.508010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 413/842] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:08.514623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:08.639031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:08.690576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9563-bf9a-4dcd-a134-53ce7ba2b35a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:08.728459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:08.729552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:08.730054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:08.730547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:08.731477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:08.731990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:08.733619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:08.748203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 430/843] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:08.754325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:08.936103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f7e3-a494-424d-aded-caefc423cd92 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:09.005456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:09.006766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.007280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.007751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.024114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:09.026993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7019e9d0-3277-49b9-9443-03609b40fce4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:09.057488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:09.058513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:09.059492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:09.060597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 414/844] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:16:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:09.066654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:09.182149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645b2ef-b47c-4f2d-8bca-638ce50031c4 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:09.206919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cf3e5-578a-4154-9f62-6f72020639df None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.207264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cf3e5-578a-4154-9f62-6f72020639df None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.207470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cf3e5-578a-4154-9f62-6f72020639df None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.209243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 415/845] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:09.213665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:09.215247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.215540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.215823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.233809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:09.234494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.234773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.236355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.236479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:09.236764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:09.238215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:09.244002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:09.246586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:09.261743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 431/846] 10.222.0.67 () {56 vars in 1149 bytes} [Fri May 27 09:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:09.267514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:09.289064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:09.366670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 416/847] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:09.389994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:09.459345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795d83-6d3e-41e5-8444-8d8ba5caf3e1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:09.504405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22876c-1d1b-43ed-8dfc-a95e61f4eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:09.505077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22876c-1d1b-43ed-8dfc-a95e61f4eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.505363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22876c-1d1b-43ed-8dfc-a95e61f4eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.505642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22876c-1d1b-43ed-8dfc-a95e61f4eac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.538673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b237e-abad-4941-b8dd-002a4974ce02 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:09.562065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:09.587876 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171081-8ca7-4340-82b8-a710305dca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:09.589309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171081-8ca7-4340-82b8-a710305dca86 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.589810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171081-8ca7-4340-82b8-a710305dca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.590303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171081-8ca7-4340-82b8-a710305dca86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.595955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22876c-1d1b-43ed-8dfc-a95e61f4eac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:09.598663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22876c-1d1b-43ed-8dfc-a95e61f4eac7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:09.609798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171081-8ca7-4340-82b8-a710305dca86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b5171081-8ca7-4340-82b8-a710305dca86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:09.626461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:09.627708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:09.628887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 417/848] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:09.630972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b735e-2e89-42de-bebf-bf4364892c7e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.631493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b735e-2e89-42de-bebf-bf4364892c7e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.631981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b735e-2e89-42de-bebf-bf4364892c7e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.636598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 418/849] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:09.637630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b735e-2e89-42de-bebf-bf4364892c7e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:09.662981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:09.760844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 432/850] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:09.762857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.763281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.763686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.789790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:09.791785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:09.809937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b735e-2e89-42de-bebf-bf4364892c7e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:09.856863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:09.858442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:09.858974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:09.859506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:09.861466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:09.861961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:09.864487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:09.885949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 419/851] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:09.885949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:09.928362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 433/852] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:09.928362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:09.946207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:10.020906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:10.042583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ab792-d146-4714-8c2d-25f58d23d04a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.081258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.082053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.082330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.082599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.093363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.095345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.096580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82674f41-34c1-4400-ae9a-9a36dbe174a8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:10.113943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:10.114926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:10.115875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:10.115875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:10.115875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:10.115875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:10.119889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 420/853] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:10.120860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.158263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.159587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.160068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.160635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.178560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.180074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:10.198305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:10.199288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:10.201148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:10.201148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:10.201148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:10.201148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:10.201148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 434/854] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:10.201148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.263520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba24a8-d626-41f6-8110-b2b1d893dbc2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.287562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:10.304975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:10.314885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.316269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.316884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.317382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.318633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.321291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.332286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72698fac-1bf8-42ff-a3c7-f8c4d6323d42 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:10.342994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:10.344071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:10.345546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:10.347080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 421/855] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:10.347249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.375393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.376518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.376804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.377084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.377887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:10.378201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.379595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.393049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 435/856] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:10.393931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.498234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573456-9e98-42db-9406-21f8253576b6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.541023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.541870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.542044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.542436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.542986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:10.543295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.544980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.576988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 422/857] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:10.576988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.586587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5236-b5a5-4f04-81df-faedd07e9813 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.616137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:10.636369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.637516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.638308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.638818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.640254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:10.642046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.644538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.656413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 436/858] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:10.657032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.669557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:10.729888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f94eba-e898-4d39-aefd-f776d75e907e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.795601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.796772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.797277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.798008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.811742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.815366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.840924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfa697-4798-4699-b72c-c03fb8f0d949 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:10.844920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:10.846866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:10.849100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:10.852715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 423/859] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:10.853675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:10.899297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:10.900788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:10.902277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:10.902741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:10.911614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:10.913756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:10.935040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:10.936289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:10.937399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 437/860] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:10.939221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:11.002075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7e71e-18db-4a38-a336-135728ba1737 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:11.011013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:11.020744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:11.052124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:11.053227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.053643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.054112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.055443 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:11.055959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:11.058542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:11.066339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 424/861] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:11.068057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:11.107847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db73a23-b27b-4c01-bb64-06293ebfcafc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:11.173883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:11.174930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.175389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.175826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.177267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:11.177765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:11.180521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbb7c0-2de3-4114-a989-10168d6122b9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:11.202894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 438/862] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:11.205398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb896f5-8519-411e-b0d4-a7880dd0fabc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.205880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb896f5-8519-411e-b0d4-a7880dd0fabc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.206344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb896f5-8519-411e-b0d4-a7880dd0fabc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.208844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 439/863] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:11.210280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb896f5-8519-411e-b0d4-a7880dd0fabc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:11.259176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e39a-98ff-441b-a492-3462befd46a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:11.317212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:11.318277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.318741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.319213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.320748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:11.321251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:11.323541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16680f-4cdd-40c8-8d6c-5dc4638abe48 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:11.347329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 425/864] 10.222.0.67 () {56 vars in 1135 bytes} [Fri May 27 09:16:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:11.353611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.354003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.354155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.373193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:11.374319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:11.379492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb896f5-8519-411e-b0d4-a7880dd0fabc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:11.390926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:11.412979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:11.423636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:11.424506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.424793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.425904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.425904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=28369b07e3cf45fa90ca15d52c45e4ee) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:11.426206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:11.427676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:11.440821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 440/865] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:11 2022] GET /identity/v3/role_assignments?user.id=28369b07e3cf45fa90ca15d52c45e4ee&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:11.442298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:11.490862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 426/866] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:11.513836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:11.599716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30de82-f38e-44d8-a483-1862abbf7d5f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:11.629469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b4785-32ac-4e4a-aeda-eb982e72c04d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:11.643741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:11.645029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.645551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.646085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.670696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:11.671395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:11.673247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:11.673540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:11.674310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:11.675729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:11.709512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:11.747377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:11.748912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:11.815040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 427/867] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:16:11 2022] POST /identity/v3/services => generated 269 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:16:11.951241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 441/868] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:16:11.961402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:12.017788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:12.156749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369aca-7c7b-445c-b5ed-3bc9a181121a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:12.220527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:12.221827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:12.222337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:12.222844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:12.241150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:12.243960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:12.278042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:12.279011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:12.279981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:12.279981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:12.279981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:12.279981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:12.284735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 428/869] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:12.300196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:12.445663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:12.513483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682109-53fc-4aab-af32-41fb3b491a60 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:12.570677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:12.571362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:12.571639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:12.571888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:12.572690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:12.572994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:12.574437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:12.590445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 442/870] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:12.599264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:12.711622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:12.740357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02a013-9b12-4dcb-946e-244e5d24f49f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:12.776026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:12.776809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:12.777094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:12.777370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:12.785388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:12.786853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:12.803337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:12.806539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:12.809171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 429/871] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:12.814003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:12.925838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238221e1-8c4e-4252-a32e-02e368234c37 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:12.958300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:12.964069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:12.964780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:12.965062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:12.965332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:12.966133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:12.966440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:12.967900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306586-3b0c-41a6-8279-e68938983404 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:12.981717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 443/872] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:12.991177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:13.127957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a61ba4-599e-40a4-96d0-67d5c39697ae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:13.169311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:13.170303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:13.170634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:13.170915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:13.171779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=7e8dcad979224353841afc735e1e7b9d) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:13.172091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:13.173688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533cab-fe2a-464a-9277-1c7bce7b8a15 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:13.175902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:13.181871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 430/873] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:12 2022] GET /identity/v3/role_assignments?user.id=7e8dcad979224353841afc735e1e7b9d&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:14.133434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd9d1-35cd-4f8a-b445-3c836577a2e2 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.134381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd9d1-35cd-4f8a-b445-3c836577a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.134381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd9d1-35cd-4f8a-b445-3c836577a2e2 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.135720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 444/874] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:14.141956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07619d1-1942-4255-a814-b089d3def945 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.142801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07619d1-1942-4255-a814-b089d3def945 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.142801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07619d1-1942-4255-a814-b089d3def945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.159547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c07619d1-1942-4255-a814-b089d3def945 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:14.160776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c07619d1-1942-4255-a814-b089d3def945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:14.170654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce618bf-61b8-43f0-b161-2a3e9a91e985 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.171131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce618bf-61b8-43f0-b161-2a3e9a91e985 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.171581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce618bf-61b8-43f0-b161-2a3e9a91e985 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.174387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 445/875] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:14.182163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.182647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.183134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.215573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:14.218778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:14.252540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 431/876] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:14 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:14.277527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07619d1-1942-4255-a814-b089d3def945 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:14.372533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 446/877] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:14 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:14.404819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:14.473151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07619d1-1942-4255-a814-b089d3def945 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:14.528435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:14.545763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86080d2-87e1-459e-8dd6-256cef7bb4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:14.547109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86080d2-87e1-459e-8dd6-256cef7bb4db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.548399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86080d2-87e1-459e-8dd6-256cef7bb4db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.548935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86080d2-87e1-459e-8dd6-256cef7bb4db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.573349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86080d2-87e1-459e-8dd6-256cef7bb4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f86080d2-87e1-459e-8dd6-256cef7bb4db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:14.592142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:14.594803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:14.597009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 432/878] 10.222.0.67 () {56 vars in 1120 bytes} [Fri May 27 09:16:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:14.599702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcfe89-042a-439f-b44c-01c297c2cfd2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.599702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcfe89-042a-439f-b44c-01c297c2cfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.599702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcfe89-042a-439f-b44c-01c297c2cfd2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.601550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 433/879] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:14.602865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcfe89-042a-439f-b44c-01c297c2cfd2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:14.606733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630715a4-0538-4a96-b16d-78416dce65f6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:14.634386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:14.656234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22060f-a67c-4873-909d-74b641eefb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:14.657912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22060f-a67c-4873-909d-74b641eefb9a None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.658387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22060f-a67c-4873-909d-74b641eefb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.658853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22060f-a67c-4873-909d-74b641eefb9a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.659669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22060f-a67c-4873-909d-74b641eefb9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:14.662217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22060f-a67c-4873-909d-74b641eefb9a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:14.730800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcfe89-042a-439f-b44c-01c297c2cfd2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:14.742226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 447/880] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:16:14 2022] POST /identity/v3/services => generated 251 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:14.743977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.744454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.744904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.777026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:14.779082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:14.824994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:14.826379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:14.826868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:14.827393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:14.829630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:14.830150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:14.833315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:14.859814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 434/881] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:16:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:14.864677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:14.913990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 448/882] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:14.937582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:14.978042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:15.050347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d85bf4-e920-4400-9414-f91b7df2ccf8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.092410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41aa90-7f76-4d54-bd86-15775bc098be None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.098407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.099236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.099518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.099803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.112608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.113321 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:15.114462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:15.136951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:15.137911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:15.139269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:15.139269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:15.139269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:15.139269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:15.139269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 435/883] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:15.146098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.161021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.163125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.163631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.164204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.165670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.168487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:15.189702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:15.190719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:15.191569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:15.194837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 449/884] 10.222.0.67 () {56 vars in 1132 bytes} [Fri May 27 09:16:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:15.205851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.289661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:15.295248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ed707-6184-4655-bf5a-cd455cd84846 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.337882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.338935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.339455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.339941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.340967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:15.341497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.343092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.358020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 436/885] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:15.367330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.416049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af4f2-5bc8-4513-aa7a-0bed380a0673 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.482805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.483903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.484434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.484971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.486025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:15.486534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.488170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.490764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110436dd-6db6-43ce-965e-34c79f2da8df None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.499198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 450/886] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:15.501065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.549594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:15.554204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.555600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.556531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.556804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.573178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.576637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:15.611858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:15.613231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:15.614468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:15.617461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 437/887] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:15.622979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.635056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a318aea-34d1-4d93-b2ac-569fe7fef462 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.651717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:15.678040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.679084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.679595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.680082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.681069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:15.681616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.683231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.689727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 451/888] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:15.699718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.763976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c588-6e49-44be-9780-891d28de6304 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.820729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.821890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.822393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.822874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.824566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:15.825111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.827764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.864203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 438/889] 10.222.0.67 () {56 vars in 1149 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:15.875643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:15.910009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d341-4f12-40e3-a73a-a79b77e3222f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:15.922240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:15.965454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:15.966580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.967387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.968008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.970827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] RBAC: Adding query filter params (interface=public, service_id=c5fd135eabda497eaacf3cab52a3b00b, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:15.971206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:15.972755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6570-1536-43ff-998f-82562bda9767 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:15.983259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 452/890] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/endpoints?service_id=c5fd135eabda497eaacf3cab52a3b00b&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:15.983259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d5aa-3aa9-4ed3-aa86-b0a9e9886148 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.983259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d5aa-3aa9-4ed3-aa86-b0a9e9886148 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.983259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d5aa-3aa9-4ed3-aa86-b0a9e9886148 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:15.983259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 453/891] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:15.989600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:15.989936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:15.990824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.012337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:16.014392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:16.034658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:16.079001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a515d-43d6-42d3-8684-4ac474314e54 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:16.116534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 454/892] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:16.117662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:16.147239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:16.148021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:16.148375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:16.148531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.250267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:16.252369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:16.267829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:16.279203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a642f-f58e-4c92-9017-092470fc07f4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:16.326116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:16.327163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:16.327603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:16.328057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.329554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:16.331183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:16.338480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 455/893] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:16 2022] GET /identity/v3/services => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:16:16.339565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:16.368210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:16.417571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 439/894] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:15 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:16.428402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:16.526373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7ad1-7fba-4f53-a51f-1c856de1c43a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:16.579816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45f6c-9754-4509-bfeb-495cf075834a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:16.584012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:16.584929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:16.585219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:16.585475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.586153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:16.587556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:16.602713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:16.603762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:16.605115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 456/895] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:16.610821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:16.625959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:16.626591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:16.626933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:16.627212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.642802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:16.645310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:16.652749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:16.675287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:16.681633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:16.683403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:16.683403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:16.683403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:16.683403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:16.683403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 440/896] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:16.686208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:16.741520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:16.820079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b429328-5cb5-4546-9f23-7bc5c8a6c837 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:16.896060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677071bf-a462-4e5a-abdc-4f6435ca643b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:16.899361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:16.900609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:16.901156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:16.901691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.903642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:16.903854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:16.905259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:16.915464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 457/897] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:16.925593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:16.974795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:16.976093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:16.976620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:16.977014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:16.977803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:16.978118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:16.980846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:17.005358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 441/898] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:17.010681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:17.109305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:17.119981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:17.134191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f078c3-443c-4ca7-a737-1ae06c7f9aef None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:17.149825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40250d-bd80-480c-8db4-0b2ee33b1534 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:17.179796 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:17.180684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.181066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.181441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.182270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:17.182697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:17.184204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:17.194265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 458/899] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:17.219896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:17.221042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.221430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.221805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.230668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:17.232289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f0b7f74a-9a2e-4812-a419-7b04c06f02c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:17.249199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:17.250182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:17.251708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:17.256025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 442/900] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:17.257588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:17.443039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ddbbd-4a94-406c-9015-3d6a15664352 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:17.488802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:17.489760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.490229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.490716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.491695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:17.492171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:17.493896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:17.497548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cc1da-87a5-4908-8ee3-fb272293f76b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.497778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cc1da-87a5-4908-8ee3-fb272293f76b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.497991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cc1da-87a5-4908-8ee3-fb272293f76b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.501953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 443/901] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:17.506576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.506862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.507142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.510798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 459/902] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:17.518497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:17.531889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:17.535093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:17.538100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:17.642190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 444/903] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:17.684115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:17.692199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd629e62-bff5-4a06-b20c-a522e9f7e9d7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:17.731998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:17.733044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.733540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.734039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.735708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] RBAC: Adding query filter params (role.id=2d58726d054d4e7eab64ebe242e894f9, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=28369b07e3cf45fa90ca15d52c45e4ee) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:17.736242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:17.738003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:17.744957 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 460/904] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:17 2022] GET /identity/v3/role_assignments?user.id=28369b07e3cf45fa90ca15d52c45e4ee&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=2d58726d054d4e7eab64ebe242e894f9 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:17.840754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:17.878196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e0ee9-29e8-4384-b056-42ff68d533af None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:17.953243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:17.954944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:17.955386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:17.955821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:17.956693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:17.958283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:17.989741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:17.990873 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:17.991726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:17.994802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 445/905] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:18.004954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:18.172828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:18.218075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770df9-d350-4ab9-9c42-c66047c9f18f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:18.286062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:18.287333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:18.287913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:18.288533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:18.289821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:18.290386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:18.293057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:18.308646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 461/906] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:18.314015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:18.495689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33e62f-2c59-4601-9353-67ceeb757740 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:18.553380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:18.554089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:18.555710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:18.555710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:18.555710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:18.555710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:18.557131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa02cb9-a20c-4ceb-b12a-025f21f905b8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:18.573724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 446/907] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:18.585735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:18.793210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f1677-68e7-4319-9511-7a9d94718084 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:18.825827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3391e-4b02-4560-b294-b16bc7e8f749 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:18.826251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3391e-4b02-4560-b294-b16bc7e8f749 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:18.826400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3391e-4b02-4560-b294-b16bc7e8f749 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:18.828005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 447/908] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:18.833749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:18.834125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:18.834378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:18.846424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:18.853040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:18.854251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:18.867684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:18.869305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:18.870054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:18.870843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:18.872675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] RBAC: Adding query filter params (interface=public, service_id=9a0267393052493594ba51a458dbd347, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:18.873511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:18.877009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:18.892490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 462/909] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:16:18 2022] GET /identity/v3/endpoints?service_id=9a0267393052493594ba51a458dbd347&interface=public®ion_id=RegionOne => generated 194 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:18.898585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:18.924897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:18.940419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 448/910] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:18.957331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:19.066288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589deb14-6c23-4773-9ccb-95d4c6d92a7f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:19.072187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f8f40-4724-4a2f-8c18-ace5a053ccc8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:19.103011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:19.103974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.104157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.104417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.105084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:19.106477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:19.109545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:19.114772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:19.115735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.116218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.116907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.117787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:19.119481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:19.121215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:19.128446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:16:19.129301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:19.131024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 463/912] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:18 2022] GET /identity/v3/services => generated 1268 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:16:19.131569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 449/912] 10.222.0.67 () {56 vars in 1132 bytes} [Fri May 27 09:16:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:19.133541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:19.218794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:19.260206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd9dde-08eb-414b-9f7d-083cd0be6e38 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:19.308950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:19.309992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.310481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.311082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.312048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:19.312605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:19.314272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:19.320634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 464/913] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:19.327587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:19.527494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1aad-8d75-44b0-974f-f97beb04aff1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:19.569271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:19.569961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.570413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.570762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.571413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:19.571718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:19.573147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257f9a-9083-4418-abd6-3c8e00f744f3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:19.579706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 450/914] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:19.588952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:19.713095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ee7c-74eb-48b3-b8c7-2afcaa2b6965 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:19.745721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:19.751710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:19.752404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.752689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.752965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.753708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:19.755103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:19.795702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65934-3cc1-43e2-94b1-921b8c444d15 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.796045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65934-3cc1-43e2-94b1-921b8c444d15 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.796286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65934-3cc1-43e2-94b1-921b8c444d15 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.798403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 451/915] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:19.804120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fe203-a27e-44c6-9297-9ab346971ad4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:19.804457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fe203-a27e-44c6-9297-9ab346971ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:19.804721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fe203-a27e-44c6-9297-9ab346971ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:19.822867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a00fe203-a27e-44c6-9297-9ab346971ad4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:19.823984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a00fe203-a27e-44c6-9297-9ab346971ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:19.882028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 465/916] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:19.905859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:19.924148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 452/917] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:19.948183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:20.074030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07df0-9051-45ef-a4b9-fdde7c33874e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:20.118658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129684f-afd1-42de-b904-a636c0c32a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:20.119760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129684f-afd1-42de-b904-a636c0c32a83 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:20.120280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129684f-afd1-42de-b904-a636c0c32a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:20.120835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129684f-afd1-42de-b904-a636c0c32a83 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:20.121827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129684f-afd1-42de-b904-a636c0c32a83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:20.123481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129684f-afd1-42de-b904-a636c0c32a83 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:20.203961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 466/918] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:16:19 2022] POST /identity/v3/services => generated 241 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:21.807821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cadcd-5e78-43fa-b8c7-8a68c7ae6401 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:21.808397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cadcd-5e78-43fa-b8c7-8a68c7ae6401 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:21.808829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cadcd-5e78-43fa-b8c7-8a68c7ae6401 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:21.812147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 453/919] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:21.821080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:21.822050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:21.822542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:21.840488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:21.842040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:21.862091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ee0d-3ab3-4ff2-93eb-d6819f665b9d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:21.862754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ee0d-3ab3-4ff2-93eb-d6819f665b9d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:21.863238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ee0d-3ab3-4ff2-93eb-d6819f665b9d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:21.865140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 454/920] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:21.870803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:21.871390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:21.871991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:21.891186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:21.892828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:21.894838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:21.936901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 467/921] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:21.973757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 455/922] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:21.978656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:21.997344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.087927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736de6e5-7c86-4ab9-b446-59592d54d9fb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.113464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aabd49-7a00-4dbe-9358-577dfc4884b6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.124983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.126353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.126641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.126921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.137376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:22.138571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:22.147808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:22.151343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:22.152504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 468/923] 10.222.0.67 () {56 vars in 1120 bytes} [Fri May 27 09:16:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:22.160602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.161468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.162506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.162952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.163393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.164243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.166067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:22.180762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:22.181843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:16:22.182715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:22.191373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 456/924] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:22.192816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.243401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:22.331166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243ea9-0858-41eb-b5cf-41deeba5853f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.369788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.370811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.371322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.371799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.372816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:22.373333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.373577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa287de-f200-4e00-ac90-6156ad62c1ae None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.375964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:22.386210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 469/925] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:16:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:22.393041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.441911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.443069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.443801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.444063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.445464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:22.446010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.448620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164663fe-e7e1-413d-a677-edb5ffa27e08 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:22.462475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 457/926] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:22.462475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a7b4-7362-4f4d-8f7f-da25a110b64e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.462475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a7b4-7362-4f4d-8f7f-da25a110b64e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.462475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a7b4-7362-4f4d-8f7f-da25a110b64e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.467898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 458/927] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:22.467898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a7b4-7362-4f4d-8f7f-da25a110b64e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.521350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:22.531447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4ed8-47e7-4cec-a4f5-78c3dd0a33e7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.538914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:22.594531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.595782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.596215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.596681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.613020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a7b4-7362-4f4d-8f7f-da25a110b64e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.615356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.617926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:22.650304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3f190c44-0bde-4559-af05-7e5ee0c2fa0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:22.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:22.651349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:22.652267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:22.652267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:22.652267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:22.652267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:22.657909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.657909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.657909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.657909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:22.657909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.658299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 470/928] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:22.658393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:22.658478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.658478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.658478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.668609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 459/929] 10.222.0.67 () {56 vars in 1114 bytes} [Fri May 27 09:16:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:22.669703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.683462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:22.685533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:22.784166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 471/930] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:22.785575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.826481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0602d-bbf9-4ee6-b795-0cf98cef2888 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.842880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:22.881514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.882192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.882474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.882748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.883480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:22.883788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.885250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:22.903779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 460/931] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:22.903779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:22.911439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:22.939335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe21b-04cc-4512-8692-4f2eb16f92e5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:22.981212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:22.981953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:22.982218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:22.982510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:22.983396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:22.985563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.023858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dcd9-47e3-423e-8691-a322840d97d7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:23.061295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:23.062104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.063148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.063363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.064041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:23.065473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.080372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 472/932] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:23.080372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:23.080762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:23.082497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:23.084051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 461/933] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:23.103449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.165255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:23.250170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb323-da6a-41ea-97fb-d566400b0728 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:23.306422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb70472-5031-4f1b-a3ec-d3001193fb0f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:23.317654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:23.319463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.319944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.320453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.321767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:23.322274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:23.325501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.337626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 462/934] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:23.346166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.374556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:23.385353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:23.395486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.395486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.395486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.395486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:23.397573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:23.417034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:23.418005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:23.418954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 473/935] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:23.425240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.515318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:23.518717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed681e80-5959-4f04-9d9a-395e4e85d17b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:23.558518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:23.559512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.559988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.560490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.561400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:23.561925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:23.564117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384ad0d-3042-4704-a00b-b1dda6bc98d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.569778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 463/936] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:23.571233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007f107-966a-442c-bd39-aecd3557d31c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.571599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007f107-966a-442c-bd39-aecd3557d31c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.571941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007f107-966a-442c-bd39-aecd3557d31c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.572134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78af6b-16be-4e92-bf58-9839f4b749b2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:23.578065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 464/937] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:23.581460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.582248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.582968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.606438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:23.607925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:23.636835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:23.638356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.639123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.639844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.642156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:23.642982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:23.646163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.683183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 474/938] 10.222.0.67 () {56 vars in 1149 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:23.690016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.702389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 465/939] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:23.755407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.760028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:23.837479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a8da-062f-4f53-88b4-dab6b0165fc9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:23.881693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:23.882511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:23.882804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:23.883076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:23.896551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:23.898071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:23.928061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:23.930386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:23.932655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:23.932655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:23.932655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:23.932655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:23.934491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 475/940] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:23.935417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:23.962926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:23.981009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b134-ea2b-4265-8bb7-4f5351bed3f7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.055509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.056495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.056780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.057043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.058008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.059246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:24.073490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:24.075469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:24.077711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:24.082392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 466/941] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:24.082392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:24.121841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:24.131868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150f573-8fcb-4327-af30-9e8b39ca7774 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.204362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.206062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.206899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.207648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.209476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:24.210385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.213496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.214763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206e41-cbe8-44d1-9608-d781972d3b7a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.238979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 476/942] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:24.245518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:24.275850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.277666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.278483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.279196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.280785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:24.282335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.285213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.301349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 467/943] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:24.309877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:24.358379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:24.377077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754eff-f139-4629-9ce5-aa7f3050110b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.446589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.448769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.449605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.450393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.465770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.466575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95909-d1d6-4cfa-ae2a-95b67fde1e27 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.469842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:24.494756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:24.496497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:24.498329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:24.503292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 477/944] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:24.510272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:24.516602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.518471 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.519315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.520105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.521727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:24.522865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.526205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.543482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 468/945] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:24.544752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:24.551222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:24.642844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a7c8-9850-4573-b53c-efdc965752eb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.690028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.690703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.690990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.691275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.692058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:24.692393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.693916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.713106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 478/946] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:24.714071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:24.769204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:24.800511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc54c-83f0-4967-be01-60a23aa5308b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.823222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:24.847092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9143f6-2d22-476b-ad1b-c5a1ca5965bb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:24.894163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fb1a-539d-4a21-b415-546eaa46f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.895095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fb1a-539d-4a21-b415-546eaa46f071 None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.895376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fb1a-539d-4a21-b415-546eaa46f071 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.895656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fb1a-539d-4a21-b415-546eaa46f071 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/28369b07e3cf45fa90ca15d52c45e4ee/roles/2d58726d054d4e7eab64ebe242e894f9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.898142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22fb1a-539d-4a21-b415-546eaa46f071 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=28369b07e3cf45fa90ca15d52c45e4ee, role_id=2d58726d054d4e7eab64ebe242e894f9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.898823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:24.899758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22fb1a-539d-4a21-b415-546eaa46f071 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.900451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:24.901148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:24.901866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:24.904848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] RBAC: Adding query filter params (interface=public, service_id=69ca88b7548f434a9686e4c4943b9a41, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:24.905640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:24.908162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:24.922642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 469/947] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:16:24 2022] GET /identity/v3/endpoints?service_id=69ca88b7548f434a9686e4c4943b9a41&interface=public®ion_id=RegionOne => generated 194 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:24.928373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:25.009386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 479/948] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:16:24 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/28369b07e3cf45fa90ca15d52c45e4ee/roles/2d58726d054d4e7eab64ebe242e894f9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:16:25.091410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ca5a2-1399-436d-b382-7a387aff0c3e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:25.161232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5699b-5b88-4d03-881c-8802aca43bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:25.162942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5699b-5b88-4d03-881c-8802aca43bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:25.163741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5699b-5b88-4d03-881c-8802aca43bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:25.164582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5699b-5b88-4d03-881c-8802aca43bd3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:25.166117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5699b-5b88-4d03-881c-8802aca43bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:25.168933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5699b-5b88-4d03-881c-8802aca43bd3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:25.182449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 470/949] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:24 2022] GET /identity/v3/services => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:16:25.977586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3170ce-8813-44d6-bb1c-a9f3b895c15e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:25.977926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3170ce-8813-44d6-bb1c-a9f3b895c15e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:25.978148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3170ce-8813-44d6-bb1c-a9f3b895c15e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:25.979814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 480/950] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:25.985436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc8d1-d43e-4863-b30e-e21355a0e26f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:25.986009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc8d1-d43e-4863-b30e-e21355a0e26f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:25.986515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc8d1-d43e-4863-b30e-e21355a0e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:26.006027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-baedc8d1-d43e-4863-b30e-e21355a0e26f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:26.007590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-baedc8d1-d43e-4863-b30e-e21355a0e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:26.019324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:26.083545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 471/951] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:26.106099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3170ce-8813-44d6-bb1c-a9f3b895c15e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:26.219548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3170ce-8813-44d6-bb1c-a9f3b895c15e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:26.260652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81f72-bc3e-4a50-8b51-5582614827ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:26.261381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81f72-bc3e-4a50-8b51-5582614827ca None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:26.261663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81f72-bc3e-4a50-8b51-5582614827ca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:26.261943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81f72-bc3e-4a50-8b51-5582614827ca None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:26.262682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e81f72-bc3e-4a50-8b51-5582614827ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:26.264119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e81f72-bc3e-4a50-8b51-5582614827ca None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:26.316736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:26.323444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 481/952] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:16:26 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:27.007123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62649d-1946-43f4-974e-a176e1641961 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.007698 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62649d-1946-43f4-974e-a176e1641961 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.008027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62649d-1946-43f4-974e-a176e1641961 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.011092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 472/953] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:27.021276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c110c-7ad0-41a0-aeec-36f0bd901756 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.022202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c110c-7ad0-41a0-aeec-36f0bd901756 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.022890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c110c-7ad0-41a0-aeec-36f0bd901756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.053307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eb9c110c-7ad0-41a0-aeec-36f0bd901756 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:27.055825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eb9c110c-7ad0-41a0-aeec-36f0bd901756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:27.183196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 482/954] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:27.224525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62649d-1946-43f4-974e-a176e1641961 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:27.393149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62649d-1946-43f4-974e-a176e1641961 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:27.400264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906215f9-75c6-491a-bbf6-ba87131d776a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.401284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906215f9-75c6-491a-bbf6-ba87131d776a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.402057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906215f9-75c6-491a-bbf6-ba87131d776a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.404966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 483/955] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:27.415554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.416565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.417358 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.448073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:27.448771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.449056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.449332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.450059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:27.450549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:27.451739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:27.453313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING keystone.server.flask.common [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 09:16:27.454036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:27.485880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:27.524823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:16:27.524823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 09:16:27.524823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [parameters: {'id': '7d31eee9bfda4e9e839e9ec75bdfb168', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 09:16:27.524823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d31eee9bfda4e9e839e9ec75bdfb168.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d31eee9bfda4e9e839e9ec75bdfb168. May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:16:27.542025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 09:16:27.543647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() May 27 09:16:27.545895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:16:27.550000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:16:27.553782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:16:27.556426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'id': '7d31eee9bfda4e9e839e9ec75bdfb168', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:27.560057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:27.566269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d31eee9bfda4e9e839e9ec75bdfb168. May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 473/956] 10.222.0.67 () {60 vars in 1140 bytes} [Fri May 27 09:16:27 2022] POST /identity/v3/projects => generated 262 bytes in 321 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:27.571292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:27.588646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 484/957] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:27.626752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:27.676012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad660f-8aa3-439e-8558-a43e1bdb2f25 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:27.714161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:27.724427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:27.729790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.729790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.729790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.741013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:27.744480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f07103c3-0100-44ee-a19f-aea0d7c818ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:27.762169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:27.763185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:27.764191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 474/958] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:27.766084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb32b-748d-442b-a487-c620d6469e53 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.766084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb32b-748d-442b-a487-c620d6469e53 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.766084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb32b-748d-442b-a487-c620d6469e53 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.774388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 475/959] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:27.774388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb32b-748d-442b-a487-c620d6469e53 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:27.776974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dae9f-0d98-424b-988c-7c0bed8e46b3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:27.822181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b046aa3-16f3-47cf-b8e1-d36eb8912cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:27.823203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b046aa3-16f3-47cf-b8e1-d36eb8912cea None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.823638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b046aa3-16f3-47cf-b8e1-d36eb8912cea None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.824064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b046aa3-16f3-47cf-b8e1-d36eb8912cea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.837295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b046aa3-16f3-47cf-b8e1-d36eb8912cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6b046aa3-16f3-47cf-b8e1-d36eb8912cea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:27.852095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:27.853275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:27.854283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 485/960] 10.222.0.67 () {56 vars in 1120 bytes} [Fri May 27 09:16:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:27.856161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.856696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.857200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.868254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:27.882469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:27.884721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:27.940158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb32b-748d-442b-a487-c620d6469e53 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:27.985600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:27.986272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:27.986554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:27.986882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:27.987590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:27.987908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:27.989382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:27.996593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 486/961] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:27.996593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.018750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 476/962] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:28.020453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.091246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:28.200015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3afd19-7024-488e-8ecd-ddb2ba6991b5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.208301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac4ca1-1696-4fa4-995b-6d2b5991e37f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.237406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:28.270175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:28.271022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.271309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.271587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.272266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:28.273875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:28.276784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:28.277720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.278168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.278453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.279224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:28.279541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:28.281594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:28.289715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:28.290990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:28.291978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:28.303440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 477/963] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:28.307341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.309335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 487/964] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:16:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:28.319515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.476464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf43bc-c294-4a62-93dd-c22572ef44a9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.478762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c79059-ee16-4ced-ae49-4f1d89302675 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.492235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:28.526714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:28.528289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.528635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.528916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.531984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:28.532709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.532996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.533279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.533998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:28.534416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:28.535832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:28.543574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 478/965] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:28.543772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:28.545398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:28.550915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:28.566935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:28.568264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:28.569663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:28.569663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:28.569663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:28.569663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:28.572587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 488/966] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:28.580432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.632992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:28.695921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d9be-0b68-4360-bc42-482cbe64da84 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.714135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47796a9-3c95-4792-990d-28bba3a5ee45 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.761275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:28.762485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.762894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.763343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.764772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:28.765390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:28.767380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:28.768069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b12c-3236-453c-9c28-530e8b90eb08 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:28.768194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.768395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.768664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.769444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:28.769753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:28.771564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:28.786874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 479/967] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:28.786874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1239f-3f5c-4066-8c78-09a8503b6fad None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.786874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1239f-3f5c-4066-8c78-09a8503b6fad None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.786874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1239f-3f5c-4066-8c78-09a8503b6fad None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.786874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 480/968] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:28.789250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:28.789612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:28.789944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:28.795094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 489/969] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:28.796362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.811460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:28.813682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:28.840375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:28.908891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 481/970] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:28.910823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:28.963084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8e96e-2c0f-41eb-afb4-86b1d406a72e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:28.998585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.006425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.007242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.007403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.007630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.008402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.009812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.072209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707052-c2e6-4555-860f-fd51fcac924d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.111029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.111841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.112127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.112430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.121136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.122580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:29.139802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:29.147442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 482/971] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:16:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:29.148741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.200889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 490/972] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:29.202555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.356006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e4dc-3ebd-459c-b474-a1087e749167 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.357595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.359975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.412360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7964-2b82-4434-8561-60790a282ca5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.418006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.418838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.419387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.419659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.420358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.421942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:29.436395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:29.438496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:29.440274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 483/973] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:29.448387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.464535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.466001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.466290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.466624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.467493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:29.467803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.469932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.493175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 491/974] 10.222.0.67 () {56 vars in 1149 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:29.499103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.586765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5e4d7-ce80-40c2-90dc-3d6a1882b1b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.624039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.624515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308ecf-173c-4550-ad60-3d32d470ea2b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.625228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.625486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.625763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.626484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:29.626797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.628203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.634175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 484/975] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:29.639892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.660415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.667588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.669105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.669569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.674919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.675048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.751520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dc76d-c7d1-4303-9606-63a817c2ae65 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.777427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.779352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.788231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.788941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.789225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.789502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.790216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:29.790519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.791900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.802579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 485/976] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:29.803534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.891848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 492/977] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:29.900904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:29.912123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.923405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4239ed-6fe7-489c-9590-a196d576b32f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:29.940687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:29.973786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:29.974631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:29.974920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:29.975203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:29.976557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] RBAC: Adding query filter params (interface=public, service_id=f6882b6488a648138e47e3b43114088c, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:29.977030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:29.978772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:29.986794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 486/978] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/endpoints?service_id=f6882b6488a648138e47e3b43114088c&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:29.992705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:30.019642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5b06-7b6b-44fe-bea0-43ccf58da35b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:30.056730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:30.057532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.057814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.058090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.070060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:30.071598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:30.090623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:30.091682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:30.092627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:30.092627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:30.092627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:30.092627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:30.092627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 493/979] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:30.100641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:30.128551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18455a-8ed5-470f-afd4-1123d54c31a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:30.168358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:30.169281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.169566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.169844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.170533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:30.172676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:30.180416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 487/980] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:29 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:16:30.248587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:30.272123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ec11a-a4c5-4457-8741-581c201c8428 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:30.315402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:30.316913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.317569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.317859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.318608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:30.319536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:30.321032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:30.335075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 494/981] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:30.343933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:30.391426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:30.500585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8015-1c30-4b86-aead-01196118289c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:30.542135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:30.543453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.544196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.544730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.553870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:30.555379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:30.572633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:30.573606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:30.574524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 488/982] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:30.584166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:30.712441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faa71d-0db9-40e3-ac05-b5f9d35349ae None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:30.748705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:30.749385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.749711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.749995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.750845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:30.751101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:30.752584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24263678-484e-47ec-ac7a-cb56932285df None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:30.766363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 495/983] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:30.776139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:30.835108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd13625-e118-4c89-bbf1-bcc780cf6e32 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.835538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd13625-e118-4c89-bbf1-bcc780cf6e32 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.835730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd13625-e118-4c89-bbf1-bcc780cf6e32 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.837120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 496/984] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:30.842623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:30.843197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:30.844305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:30.849697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:30.862058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:30.863592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:30.944355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:30.945087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 497/985] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:30.966564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:30.967077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb90d-c459-4b5a-a8c3-7a19ef035c62 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:31.036351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:31.037493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:31.038051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:31.038829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:31.040203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] RBAC: Adding query filter params (role.id=2d58726d054d4e7eab64ebe242e894f9, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=28369b07e3cf45fa90ca15d52c45e4ee) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:31.040815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:31.043606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:31.060663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 489/986] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:30 2022] GET /identity/v3/role_assignments?user.id=28369b07e3cf45fa90ca15d52c45e4ee&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=2d58726d054d4e7eab64ebe242e894f9 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:31.112797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418114e4-374f-4bc3-865e-1678d0cbdf89 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:31.158528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:31.167195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:31.169111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:31.169996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:31.170753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:31.172489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:31.175511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:31.178387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING keystone.server.flask.common [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 09:16:31.223490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.sql.core [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:16:31.223490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 09:16:31.223490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [parameters: {'user_id': 'd4fba9d383064d069a6045a2deaae020', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 09:16:31.223490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() May 27 09:16:31.246694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:16:31.247685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application yield resource May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application next(self.gen) May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise self.value May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application session.commit() May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:16:31.248654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.session.flush() May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application compat.raise_( May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:16:31.250571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:16:31.251469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application conn.query(q) May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application result.read() May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:16:31.253283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd4fba9d383064d069a6045a2deaae020', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:31.255339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 09:16:31.257232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:31.259374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 498/987] 10.222.0.67 () {60 vars in 1131 bytes} [Fri May 27 09:16:30 2022] POST /identity/v3/users => generated 160 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:31.260259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:31.421166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1cb5-8af5-4766-8790-8e8b430bfffa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:31.489097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:31.490535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:31.491045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:31.491550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:31.506474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:31.509064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-891cdbbc-b2ea-4d0b-aea2-ebddb91370b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:31.531202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:31.532369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:16:31.533365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:31.533928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 490/988] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:31.541735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:31.654278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1378c6-e7b9-4897-98aa-0d88a07c6830 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:31.692531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:31.693139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:31.693425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:31.693698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:31.694518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:31.694829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:31.696536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51809b8-ae55-40d0-ba1b-2a43754cfb92 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:31.741345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 499/989] 10.222.0.67 () {56 vars in 1101 bytes} [Fri May 27 09:16:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:31.983246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5bfd4-363d-43ae-95e6-d2a18261d819 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:31.983510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5bfd4-363d-43ae-95e6-d2a18261d819 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:31.983745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5bfd4-363d-43ae-95e6-d2a18261d819 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:31.985641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 491/990] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:31.991647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:31.991999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:31.992218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.011789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:32.014238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:32.075715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:32.116596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 500/991] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:32.154047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5bfd4-363d-43ae-95e6-d2a18261d819 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:32.169181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:32.289141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5bfd4-363d-43ae-95e6-d2a18261d819 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:32.347176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:32.348265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:32.348854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:32.348854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.349677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:32.351412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-91b70d29-23de-4bc2-aeaa-7a2a5d8ebe30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:32.368606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:32.377356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:32.378625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 492/992] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:32.384551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:32.562498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd108c-7b11-4b43-b407-290b8b628add None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:32.620040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:32.621201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:32.621712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:32.622187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.623572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:32.624152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:32.626796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67dc71-e055-4f74-a42f-1d8f9dbe66ec None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:32.627159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67dc71-e055-4f74-a42f-1d8f9dbe66ec None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:32.627342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67dc71-e055-4f74-a42f-1d8f9dbe66ec None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.627501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:32.629211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 493/993] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:32.634829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:32.635242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:32.635400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.644539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 501/994] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:32.647719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:32.662658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:32.663878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:32.714544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:32.737606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:32.742796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 494/995] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:32.770100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:32.784529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d01e4-e635-4e0b-bdd5-876427525279 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:32.839247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:32.840962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:32.841588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:32.842166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.843573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:32.844566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:32.847902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:32.856620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 502/996] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:32.863234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:32.909908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92520a-25d3-4191-bd41-8194ca59b708 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:32.972551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:32.973902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:32.974486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:32.974826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:32.975999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:32.978540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:32.986552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50b4b-467e-4098-94b2-52156ef58b70 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:32.998757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:33.000368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:33.001365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:16:33.002248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:33.003757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 495/997] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:33.008833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:33.030362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:33.031068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.031352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.031633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.032498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] RBAC: Adding query filter params (interface=admin, service_id=69ca88b7548f434a9686e4c4943b9a41, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:33.032815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:33.034247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:33.045004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 503/998] 10.222.0.67 () {56 vars in 1249 bytes} [Fri May 27 09:16:32 2022] GET /identity/v3/endpoints?service_id=69ca88b7548f434a9686e4c4943b9a41&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:33.045779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:33.103126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:33.153536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aabc0-c637-4d20-8e96-f83c1f245ba2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:33.173322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571adf-9636-4184-8977-4f892b48aec9 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:33.195956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:33.196659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.196936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.197204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.197906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:33.198208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:33.199794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:33.209583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 496/999] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:33.210900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:33.236531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:33.237135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.237552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.237995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.238858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:33.240613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:33.260445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 504/1000] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:33 2022] GET /identity/v3/services => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:16:33.367267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1105ac-a81e-464e-afa8-a808e062ceb0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:33.399553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:33.410043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:33.411148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.411561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.411943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.412848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:33.413264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:33.424566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa64c0-7e70-49ef-866c-b95cfd51aa6c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:33.424566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 497/1001] 10.222.0.67 () {56 vars in 1112 bytes} [Fri May 27 09:16:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:33.428795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:33.479743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:33.489196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fa7d4-f81e-4f37-8d53-ba51af164a78 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.489647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fa7d4-f81e-4f37-8d53-ba51af164a78 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.492899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fa7d4-f81e-4f37-8d53-ba51af164a78 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.492899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 498/1002] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:33.498644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.499424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.499876 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.520963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:33.522790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:33.562058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7db85-7d2c-405b-ab90-a41503f78985 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:33.602756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:33.603419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.603719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.604007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.604777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:33.606290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:33.606903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 499/1003] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:33.631579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:33.731269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 505/1004] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:16:33.754619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6838d-d13f-40da-b83c-2115debf6b59 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:33.800153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:33.835089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:33.836482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:33.836973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:33.837454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:33.838696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:33.842556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:33.865594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:33.866684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:33.867566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:33.868394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 500/1005] 10.222.0.67 () {56 vars in 1105 bytes} [Fri May 27 09:16:33 2022] GET /identity/v3/services/image => generated 86 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:33.873946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:33.986789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:33.996772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6c6e4-1b56-4a45-9038-4e961d34be69 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:34.038195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:34.039147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:34.039465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:34.039737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:34.040500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] RBAC: Adding query filter params (name=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:34.040813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:34.042437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9f6c7-a996-4a8b-abe6-b9c15690d368 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:34.048864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 506/1006] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:34.055248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:34.222173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc4fd6-b5e0-4b63-a531-8b9b352891de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:34.280419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:34.282087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:34.282553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:34.283026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:34.284190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] RBAC: Adding query filter params (type=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:34.284701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:34.287040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfa6b1-c603-4d8e-a002-84663ab789fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:34.303074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 501/1007] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:36.140946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf4dfe-8a98-442b-bb4c-d58b434db2b3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.141574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf4dfe-8a98-442b-bb4c-d58b434db2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.141574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf4dfe-8a98-442b-bb4c-d58b434db2b3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.143080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 507/1008] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:36.148470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.148953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.149051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.166847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:36.168052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:36.219237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:36.252390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 502/1009] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:36 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:36.274092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf4dfe-8a98-442b-bb4c-d58b434db2b3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:36.395764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf4dfe-8a98-442b-bb4c-d58b434db2b3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:36.433821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b4753-06bd-464e-a343-ed17e9e8b589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:36.434693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b4753-06bd-464e-a343-ed17e9e8b589 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.434979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b4753-06bd-464e-a343-ed17e9e8b589 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.435256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b4753-06bd-464e-a343-ed17e9e8b589 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.446911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b4753-06bd-464e-a343-ed17e9e8b589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-002b4753-06bd-464e-a343-ed17e9e8b589 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:36.455934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:36.457125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:36.463068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 508/1010] 10.222.0.67 () {56 vars in 1120 bytes} [Fri May 27 09:16:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:36.463778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:36.530569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba810a3-b230-4237-a7ee-1b2bf6bd4f5a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.531077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba810a3-b230-4237-a7ee-1b2bf6bd4f5a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.531581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba810a3-b230-4237-a7ee-1b2bf6bd4f5a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.536526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 509/1011] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:36.539866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.540206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.540575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.559302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:36.560534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:36.582839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:36.583874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7359373-9203-4be0-a332-a92dc09421a4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:36.634148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:36.635457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.635887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.636557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.637490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:36.638094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:36.640836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:36.650828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 510/1012] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:36 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:36.656623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 503/1013] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:16:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:36.657969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:36.674038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:36.726943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:36.784486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4ef59-1b8c-414e-9122-f6e2f9d12947 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:36.806086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a702-712b-4984-a6be-cb029a2cd70a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:36.839067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:36.840302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.840808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.841281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.857378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:36.860547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:36.861566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:36.863092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:36.863771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:36.864471 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:36.865586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:36.868474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:36.875828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:36.891483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:36.892890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:16:36.899241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:36.903546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:36.904575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:36.905500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:36.905500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:36.905500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:36.905500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:36.905729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 504/1014] 10.222.0.67 () {56 vars in 1126 bytes} [Fri May 27 09:16:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:36.905800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 511/1015] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:36.905868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:36.905945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.068074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e310fb-de57-4f85-a636-03e3794ed8f2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.070454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:37.077361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60405ad-cc80-4573-adf6-4cfe4fed9147 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.110331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.111010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.111288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.111578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.112285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:37.112612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.113996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.119329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 505/1016] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:37.121356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.122025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.122306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.122580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.123303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:37.123608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.125064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.128603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.141560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 512/1017] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:37.146899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.232142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:37.256663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4a922-096d-458d-ba62-9fdd7447a493 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.284979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94c24-4bfe-466f-96f4-fc672ec4830e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.300090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.301715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.302164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.302591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.303675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:37.304573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.306477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.314402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 506/1018] 10.222.0.67 () {56 vars in 1122 bytes} [Fri May 27 09:16:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:37.321882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.332213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.333084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.333370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.333651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.343969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.345676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:37.361739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:37.363436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:37.364979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 513/1019] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:16:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:37.368779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.369516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:37.454119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38329b8-c844-44ce-ab6a-144b8be79ca6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.474934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f60868-148f-427a-9596-b30222a58e02 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.490233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88179c-3811-4c60-b5ae-9185febf819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.490819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88179c-3811-4c60-b5ae-9185febf819a None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.491095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88179c-3811-4c60-b5ae-9185febf819a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.491368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88179c-3811-4c60-b5ae-9185febf819a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.492105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88179c-3811-4c60-b5ae-9185febf819a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.493514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88179c-3811-4c60-b5ae-9185febf819a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.500503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:37.515067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.515736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.516022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.516297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.517188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:37.517495 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.518943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605b910-a826-47c3-a76d-ae67845c4b58 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.536914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 514/1020] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:16:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:37.538263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064e9b-df0c-41a8-b066-6fd10584ddeb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.538552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064e9b-df0c-41a8-b066-6fd10584ddeb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.538828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064e9b-df0c-41a8-b066-6fd10584ddeb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.540270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 515/1021] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:37.543976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064e9b-df0c-41a8-b066-6fd10584ddeb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.589171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 507/1022] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:37.590493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.590828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.591107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.611269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:37.612603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:37.697621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064e9b-df0c-41a8-b066-6fd10584ddeb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.718173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 508/1023] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:37.741834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:37.747030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.748102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.748639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.749167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.769794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:37.810045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:37.848102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.849884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.880838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7804-3adb-4dc5-9abe-1dd9e4baff80 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:37.925351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:37.926039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:37.926327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:37.926606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:37.927359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:37.929011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:37.976852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 516/1024] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:37 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:37.983203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:38.007917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 509/1025] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:16:37 2022] POST /identity/v3/services => generated 242 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:16:38.109627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:38.138356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214c15-4434-4a7f-b22b-8354d4710860 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:38.186623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:38.187557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:38.187740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:38.188016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:38.201056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:38.203667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:38.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:38.226292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:38.227305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:38.227305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:38.227305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:38.227305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:38.227585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 517/1026] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:38.234862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:38.362827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:38.389545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395883-f46a-42fe-9740-14f0e6acfc85 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:38.441908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:38.442776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:38.443188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:38.443649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:38.444491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:38.444836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:38.446941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:38.471858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 510/1027] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:38.473717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:38.589904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d73be-f17a-4454-8144-fa643033371f None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:38.615171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:38.638404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:38.639725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:38.640834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:38.641343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:38.653768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:38.656652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:38.680168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:38.682023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:38.683723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 518/1028] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:38.694188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:38.877377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2d10c-dfdc-4638-bf65-2d6cae216a22 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:38.938786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:38.939623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:38.940127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:38.940681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:38.942280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:38.942945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:38.945274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e0ed-7573-41d6-8b9c-15b602260875 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:38.962602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:38.976376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 511/1029] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:38.980314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:39.157040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8db4-3120-4f76-a2f7-be3f08a665ed None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:39.205491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:39.206488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:39.206875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:39.207138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:39.208512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] RBAC: Adding query filter params (role.id=2d58726d054d4e7eab64ebe242e894f9, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=cd4d716fddeb41d1a697a0f23db35a26) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:39.208845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:39.210626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945833f1-9882-4312-9ef4-657303f3f647 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:39.220315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 519/1030] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:38 2022] GET /identity/v3/role_assignments?user.id=cd4d716fddeb41d1a697a0f23db35a26&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=2d58726d054d4e7eab64ebe242e894f9 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:39.896669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e704356-c350-470a-a037-f52247b39e51 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:39.897210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e704356-c350-470a-a037-f52247b39e51 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:39.897210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e704356-c350-470a-a037-f52247b39e51 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:39.898830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 512/1031] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:39.904828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:39.905343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:39.905878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:39.935148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:39.937808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:40.016608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:40.068355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 520/1032] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:40.089862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e704356-c350-470a-a037-f52247b39e51 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:40.242079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e704356-c350-470a-a037-f52247b39e51 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:40.305962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6e1d-b929-4da7-9209-d2807a3ce1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:40.307375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6e1d-b929-4da7-9209-d2807a3ce1bf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:40.307892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6e1d-b929-4da7-9209-d2807a3ce1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:40.308426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6e1d-b929-4da7-9209-d2807a3ce1bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:40.310348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa6e1d-b929-4da7-9209-d2807a3ce1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:40.313687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa6e1d-b929-4da7-9209-d2807a3ce1bf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:40.322063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 513/1033] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:40.323377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:40.342428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa093-cafc-4c68-8d62-14833746756f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:40.342746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa093-cafc-4c68-8d62-14833746756f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:40.343036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa093-cafc-4c68-8d62-14833746756f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:40.344949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 514/1034] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:40.350166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181841e-5266-446a-bc30-4b648700f816 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:40.350455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181841e-5266-446a-bc30-4b648700f816 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:40.350741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181841e-5266-446a-bc30-4b648700f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:40.368601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f181841e-5266-446a-bc30-4b648700f816 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:40.369809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f181841e-5266-446a-bc30-4b648700f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:40.444650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:40.452134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 515/1035] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:40.475364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181841e-5266-446a-bc30-4b648700f816 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:40.496379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef5660-5c19-4318-a311-a987a371e267 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:40.552381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:40.552381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:40.552381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:40.552381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:40.552812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:40.552812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:40.606695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181841e-5266-446a-bc30-4b648700f816 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:40.645928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:40.646782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:40.647062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:40.647335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:40.648028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:40.649444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:40.661772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:40.663810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:40.664860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 516/1036] 10.222.0.67 () {56 vars in 1105 bytes} [Fri May 27 09:16:40 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:40.670091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:40.678728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 521/1037] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:16:40 2022] POST /identity/v3/projects => generated 311 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:40.786798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:40.852380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db674684-ede8-4c66-a0f3-ef6f7e53f4ff None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:40.903772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:40.904813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:40.904813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:40.905065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:40.906349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:40.906658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:40.908136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:40.915889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 517/1038] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:40.923081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:40.969136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:41.047464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bfbac-2cc2-458a-97e7-ff8e529048b0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:41.086622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:41.087297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:41.087577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:41.087849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:41.088593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] RBAC: Adding query filter params (type=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:41.088908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:41.090307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:41.096932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 522/1039] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:41.103432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:41.283045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f330-0391-447a-ad26-4c6f80c59dd3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:41.335077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:41.351014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:41.354965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:41.354965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:41.354965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:41.354965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] RBAC: Adding query filter params (interface=public, service_id=82d52365eebb483ca7d29378e5ce7d91, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:41.355359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:41.357987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87829110-8218-4eea-9c10-e3e024304a65 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:41.369692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 518/1040] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:16:41 2022] GET /identity/v3/endpoints?service_id=82d52365eebb483ca7d29378e5ce7d91&interface=public®ion_id=RegionOne => generated 194 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:41.377704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:41.532902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:41.552301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14a7d3-c959-486d-9e65-2deab511a9ec None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:41.613994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106cecc-5055-4ca6-9df6-419f3bf96ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:41.614953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106cecc-5055-4ca6-9df6-419f3bf96ccf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:41.615472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106cecc-5055-4ca6-9df6-419f3bf96ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:41.615831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106cecc-5055-4ca6-9df6-419f3bf96ccf None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:41.617004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106cecc-5055-4ca6-9df6-419f3bf96ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:41.619595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106cecc-5055-4ca6-9df6-419f3bf96ccf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:41.640735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 523/1041] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:16:41 2022] GET /identity/v3/services => generated 1957 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:16:41.656253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b24ec-3d9b-46b0-aa31-c450cd184490 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:41.656785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b24ec-3d9b-46b0-aa31-c450cd184490 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:41.657299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b24ec-3d9b-46b0-aa31-c450cd184490 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:41.660093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 519/1042] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:41.667307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:41.667634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:41.667908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:41.690135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:41.691653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:41.791466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 524/1043] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:41.820474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b24ec-3d9b-46b0-aa31-c450cd184490 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:41.953306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b24ec-3d9b-46b0-aa31-c450cd184490 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:41.991186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:41.992356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:41.992857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:41.993317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:42.006089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:42.015480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:42.016570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:42.017558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:42.018782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 520/1044] 10.222.0.67 () {56 vars in 1120 bytes} [Fri May 27 09:16:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:42.025131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:42.121493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:42.139076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35296-107a-42d0-aed4-05d426694d09 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:42.179564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:42.180250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:42.180550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:42.180908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:42.181666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:42.181982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:42.183386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:42.196430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 525/1045] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:16:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:42.199835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:42.260524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:42.325187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134311e8-88de-46bf-bc6d-1f905198b8ef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:42.366956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:42.367767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:42.368044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:42.368345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:42.379815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:42.381382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:42.413694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:42.415111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:42.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:42.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:42.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:42.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:42.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 521/1046] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:42.422440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:42.542763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4162-9c7a-41a7-b098-933c46c62cf6 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:42.591546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:42.592241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:42.592569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:42.592890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:42.593659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:42.593964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:42.595455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:42.611555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 526/1047] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:42.618411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:42.796662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7368f3-df47-418e-b53b-f44bdc456b0d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:42.799767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:42.856498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:42.857900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:42.858896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:42.859385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:42.875115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:42.877631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7fcd81bb-4a06-4a90-a935-9fac62e3368b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:42.905633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:42.906712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:42.907726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:42.908813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 522/1048] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:16:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:42.914709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:42.935805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:43.062624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669b86-354f-4f13-83c8-193555aaec37 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.063144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669b86-354f-4f13-83c8-193555aaec37 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.063144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669b86-354f-4f13-83c8-193555aaec37 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.064483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 523/1049] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:43.070094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.070384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.070699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.075930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e20f-2b3e-4bd1-bf78-99cb5f67cde2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:43.089592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:43.090874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:43.128125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:43.128837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.129126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.129403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.130375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:43.130969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:43.132501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:43.157093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 527/1050] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:16:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:43.162305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:43.177811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 524/1051] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:43.202953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:43.270604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:43.324432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:43.333615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8331c1d-7326-4c5a-a2a9-d4b6152bbc58 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:43.338545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25a0c1-eb5a-4888-868d-69b3e8924ec7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:43.380252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:43.381103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.381390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.381681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.387678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:43.388579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.388840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.389089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.390999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:43.393007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:43.394307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:43.395857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:43.399513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 525/1052] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:43.406247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:43.418974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:43.421351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:43.424483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:43.424483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:43.424483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:43.424483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:43.426233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 528/1053] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:43.426896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:43.543552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a26a37-b141-4602-9708-231ad01188a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:43.568216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edd2c-0117-4c86-acb2-43f806812320 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:43.588487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:43.589427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.589721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.590170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.591421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:43.591931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:43.593517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:43.611798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:43.612514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.612804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.613078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.613802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:43.614128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:43.615544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:43.627959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 529/1054] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:43.633946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:43.700623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 526/1055] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:16:43 2022] POST /identity/v3/users => generated 285 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:43.766130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b5d2-10cb-4d4c-b4d1-1e2bf5f92310 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:43.808876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:43.809695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:43.809973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:43.810246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:43.818833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:43.820358 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c304614a-d0bb-4355-af84-1a8cde018e5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:43.845894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:43.847133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:43.848097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:43.848575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 530/1056] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:43.853892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:43.885112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:43.983369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512666a-5193-4504-937f-e7479c43ef82 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:44.039491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:44.040813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.041392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.041984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.043882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:44.044580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:44.047511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:44.066451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646cd31-b9f9-4509-96ad-48c62022f59a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.066790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646cd31-b9f9-4509-96ad-48c62022f59a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.067023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646cd31-b9f9-4509-96ad-48c62022f59a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.068575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 531/1057] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:44.071661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 527/1058] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:44.073774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.074060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.074339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.078712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:44.095078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:44.096835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:44.130764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:44.188660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 532/1059] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:44.193549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:44.211939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:44.221277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69421-ce12-48c8-854d-aadce00105ec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:44.264681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:44.265592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.265883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.266155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/cd4d716fddeb41d1a697a0f23db35a26/roles/2d58726d054d4e7eab64ebe242e894f9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.268497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=cd4d716fddeb41d1a697a0f23db35a26, role_id=2d58726d054d4e7eab64ebe242e894f9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:44.269950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:44.335494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 528/1060] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:16:44 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/cd4d716fddeb41d1a697a0f23db35a26/roles/2d58726d054d4e7eab64ebe242e894f9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:16:44.335907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eeb7b-39bd-4035-af7a-72798cdcbd89 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:44.379171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:44.380443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.380944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.381444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] PATH_INFO: `/v3/services/image` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.382348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:44.384030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:44.397129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:44.398231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:16:44.399098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:44.404568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 533/1061] 10.222.0.67 () {56 vars in 1105 bytes} [Fri May 27 09:16:44 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:44.406753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:44.544295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b163f1-2d13-4bc3-a37f-8031a69e62e0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:44.585668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:44.586743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.587243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.587724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.588696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] RBAC: Adding query filter params (name=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:44.589227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:44.590819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:44.594173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:44.598115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 529/1062] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:44.606723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:44.647595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:44.734408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e3ec0-5640-4d6b-b454-21aa5da3faec None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:44.775412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:44.776078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.776380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.776660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.777365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] RBAC: Adding query filter params (type=image) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:44.777684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:44.779055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695ff66-f84d-49dc-b2b1-ec6daaff8542 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:44.789880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 534/1063] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:44.791633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:44.922047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd80e3-d9fc-47da-82b9-3a83c5fbe3ef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:44.965508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015e5f4-9c5b-46ce-be0b-e9f3a338916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:44.966668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015e5f4-9c5b-46ce-be0b-e9f3a338916b None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:44.967174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015e5f4-9c5b-46ce-be0b-e9f3a338916b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:44.967742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015e5f4-9c5b-46ce-be0b-e9f3a338916b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:44.969194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015e5f4-9c5b-46ce-be0b-e9f3a338916b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:44.972340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015e5f4-9c5b-46ce-be0b-e9f3a338916b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:45.064650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 530/1064] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:16:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:16:46.069808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf779-b21d-48a6-805d-b072a5cf33fb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.070360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf779-b21d-48a6-805d-b072a5cf33fb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.070360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf779-b21d-48a6-805d-b072a5cf33fb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.072039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 535/1065] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:16:46.078020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.078539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.078642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.097923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:46.099197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:46.184552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:46.209652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 531/1066] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:46.234016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf779-b21d-48a6-805d-b072a5cf33fb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:46.341598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:46.348751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf779-b21d-48a6-805d-b072a5cf33fb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:46.383828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:46.384664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.384952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.385232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.396586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:46.405466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:46.406704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:46.408053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 536/1067] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:46.413116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:46.519571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ac72b-4373-4415-a131-55f59be28139 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:46.555740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:46.556491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.556784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.557062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.557801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:46.558105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:46.559513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068e0ac-5c1e-4540-a0a0-e842a85afa21 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:46.568217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 532/1068] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:46.573739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:46.603686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b1d8a-3b81-405a-b071-1bbff45c5fe4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.603988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b1d8a-3b81-405a-b071-1bbff45c5fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.604641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b1d8a-3b81-405a-b071-1bbff45c5fe4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.606447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 533/1069] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:46.611861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.612157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.612455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.629183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:46.630372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:46.674450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:46.686757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed709-3828-4bc4-9671-578656265bd3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:46.704020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 534/1070] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:46.723931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:46.724886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.725229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.725447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] PATH_INFO: `/v3/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.736242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:46.742075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] RBAC: Authorizing `identity:get_user(user_id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:46.743578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:46.745621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 537/1071] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:16:46 2022] GET /identity/v3/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:46.751702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:46.767785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:46.847328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176438-8ab0-4518-976f-1ac893078db3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:46.889784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc928bb-0f8a-47f2-93cd-7a77031c378e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:46.895847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:46.897277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.897781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.898278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.912461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:46.921996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:46.923862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:46.924778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 535/1072] 10.222.0.67 () {56 vars in 1120 bytes} [Fri May 27 09:16:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:46.929166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:46.931191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:46.931872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:46.932169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:46.932439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:46.966432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.005166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.006684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.021779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.035594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ff6c-7bc1-495e-960c-3f4532781809 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.075522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.076214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.076560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.076968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.077742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:47.078173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.079572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.094869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 536/1073] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:16:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:47.095719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.118666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 538/1074] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:47.124191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.210173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.219390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f072c7-d36d-4969-a6c3-97844b3634ef None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.238398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e0db-0f86-45d7-bc13-f71cdf90ce23 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.255151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.260960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.262062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.262549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.263078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.274634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.276088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.277563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.278440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.278730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.279007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.280806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=651527a3032648eca8af465576cbb8a7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.282239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.284131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 539/1075] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/projects/651527a3032648eca8af465576cbb8a7 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:47.290008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:47.301337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:47.302323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:47.303254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:47.303254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:47.303254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:47.303254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:47.307356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 537/1076] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:47.308349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.400089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed2bc-7a35-48c4-abaa-06c25bd52ad3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.417762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd9db-4eea-4f06-9381-288040e41ee9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.435200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.435854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.436160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.436475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.437411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=651527a3032648eca8af465576cbb8a7, user.id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:47.437725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.439204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d394e8-7ced-4235-b9d3-4657606f21d3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.444896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 540/1077] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/role_assignments?user.id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf&scope.project.id=651527a3032648eca8af465576cbb8a7&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:47.446117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714e237-dd2a-43b9-8313-8b05e1fa124e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.446404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714e237-dd2a-43b9-8313-8b05e1fa124e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.446687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714e237-dd2a-43b9-8313-8b05e1fa124e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.447966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 541/1078] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:47.454322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.454654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.454891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.460466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.462511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.463061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.463605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.464691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:47.465262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.468162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.473520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:47.474751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:47.484794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 538/1079] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:47.490386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.502131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.534729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.569079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 542/1080] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:16:47.592516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.612362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5036d-e8d7-4f0e-9d09-718030aea99c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.651254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.652055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.652353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.652629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.660531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.661991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:16:47.678115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:47.679318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:16:47.680606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:47.684147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 539/1081] 10.222.0.67 () {56 vars in 1093 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:47.685141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.720391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bff68-25f6-4dd0-81e9-19c6e1cd58d6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.756187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.759237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.759895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.760176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.760483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.792118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a5df-6ecd-4285-ab2e-58da5e680878 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:47.812009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:47.831034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:47.831700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:47.831985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:47.832264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:47.833145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:47.833454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.834905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.836145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:47.837657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:47.853858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 540/1082] 10.222.0.67 () {56 vars in 1133 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:16:47.859617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.953529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 543/1083] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:47.960362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:47.973856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e0cd-d650-4d6e-90f2-c7f67fc04af3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:48.011334 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:48.021776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:48.022408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:48.022610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:48.022887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:48.050571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:48.077412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39e97-8e1e-4f06-ba3e-f69f5c77ef8b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:48.100023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:48.101513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:48.116171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:48.117006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:48.117287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:48.117569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:48.128762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:48.130338 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:48.150848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:48.151850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:48.152836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:48.152836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:48.152836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:48.152836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:48.157189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 544/1084] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:48.158356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:48.221012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 541/1085] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:16:48.227315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:48.269941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:48.294494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c67a-580f-477d-98e6-4049ba77d471 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:48.326994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:48.336620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:48.337927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:48.337927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:48.337927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:48.338640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:48.338954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:48.341428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:48.363339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 545/1086] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:48.379752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843cc7a-8876-4d34-b9e4-5ec9862a8513 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:48.451240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:48.452745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:48.453371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:48.453891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:48.473099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:48.474574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:16:48.494652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:48.495604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:48.496550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:16:48.496550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:16:48.496550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:16:48.496550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:48.497407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 542/1087] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:16:48.502446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:48.662800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfedc-c81d-494a-b066-b4fd648aa8aa None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:48.709328 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:48.710014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:48.710303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:48.710583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:48.711323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:48.711631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:48.713137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:48.729210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 546/1088] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:48.734783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:48.831348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:48.855631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdb2b-2fc5-49a3-809e-382f0f920cd3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:48.893042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:48.893843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:48.894121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:48.894405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:48.904466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:48.906600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:16:48.921306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:48.922438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:48.923441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 543/1089] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:48.928799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:48.999648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:49.068866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b75c7-d657-48f8-96cd-6dbcb45e2ae2 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:49.127509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:49.128602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:49.129101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:49.129671 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:49.131168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:49.131693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:49.134384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909b3f-644e-4028-99d1-d4033e6fa712 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:49.156960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 547/1090] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:49.163152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:49.274866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34102137-e49c-45bb-bc8d-df08100d981e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:49.310040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:49.310703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:49.311538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:49.311807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:49.312677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] RBAC: Adding query filter params (role.id=2d58726d054d4e7eab64ebe242e894f9, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=cd4d716fddeb41d1a697a0f23db35a26) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:49.312989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:49.314420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef596aa-b4ca-4706-9bd2-0343a9d70464 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:49.321671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 544/1091] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:49 2022] GET /identity/v3/role_assignments?user.id=cd4d716fddeb41d1a697a0f23db35a26&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=2d58726d054d4e7eab64ebe242e894f9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:49.692535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aed42-f36d-4e23-9a4e-3972a8a7b3f5 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:49.692830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aed42-f36d-4e23-9a4e-3972a8a7b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:49.693114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aed42-f36d-4e23-9a4e-3972a8a7b3f5 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:49.694586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 548/1092] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:49.700863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:49.701155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:49.701434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:49.707260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:49.721304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:49.722528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:49.807384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 545/1093] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:49.827139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aed42-f36d-4e23-9a4e-3972a8a7b3f5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:49.954125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aed42-f36d-4e23-9a4e-3972a8a7b3f5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:49.964938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:49.992993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:49.993599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:49.993890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:49.994198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:50.010691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:50.019289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:50.020572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:16:50.021494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 549/1094] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:50.026936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:50.139662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1447b-6818-4f23-989a-a17315eb6719 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:50.173001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:50.178028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:50.178708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:50.178997 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:50.179282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:50.180051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:50.180383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:50.181778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:50.191482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 546/1095] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:50.198079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:50.318037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212f8a-7697-4f74-9ee3-88d0b3ed2a77 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:50.353296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:50.354172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:50.354449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:50.354724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] PATH_INFO: `/v3/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:50.355909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] RBAC: Authorizing `identity:get_user(user_id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:50.357383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:50.359047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 550/1096] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:16:50 2022] GET /identity/v3/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:50.365018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:50.466564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abca5-2238-4b93-8fae-6cfd64f278e7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:50.500509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea5a89-7bb4-4e3b-ade6-12aa4aa56f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:50.501369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5a89-7bb4-4e3b-ade6-12aa4aa56f10 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:50.501647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5a89-7bb4-4e3b-ade6-12aa4aa56f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:50.501923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea5a89-7bb4-4e3b-ade6-12aa4aa56f10 None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:50.503119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5a89-7bb4-4e3b-ade6-12aa4aa56f10 None admin] RBAC: Authorizing `identity:get_project(project_id=651527a3032648eca8af465576cbb8a7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:50.504577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea5a89-7bb4-4e3b-ade6-12aa4aa56f10 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:50.506262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 547/1097] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:16:50 2022] GET /identity/v3/projects/651527a3032648eca8af465576cbb8a7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:50.517463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:50.554280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:50.618382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e27f5c-6123-4ead-81be-85f903b61d34 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:50.651998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd336aef-4ec1-4f2f-9d56-5ca98881952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:50.652902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd336aef-4ec1-4f2f-9d56-5ca98881952a None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:50.653177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd336aef-4ec1-4f2f-9d56-5ca98881952a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:50.653453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd336aef-4ec1-4f2f-9d56-5ca98881952a None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:50.655485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd336aef-4ec1-4f2f-9d56-5ca98881952a None admin] RBAC: Authorizing `identity:create_grant(project_id=651527a3032648eca8af465576cbb8a7, user_id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:50.656961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd336aef-4ec1-4f2f-9d56-5ca98881952a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:50.754830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 551/1098] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:16:50 2022] PUT /identity/v3/projects/651527a3032648eca8af465576cbb8a7/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:16:52.978849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4644-0b6b-4c7b-ba8b-57847dd246e7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:52.979412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4644-0b6b-4c7b-ba8b-57847dd246e7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:52.979412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4644-0b6b-4c7b-ba8b-57847dd246e7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:52.980840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 548/1099] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:52.987308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476644d-563a-4f92-bd62-25252100db07 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:52.987746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476644d-563a-4f92-bd62-25252100db07 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:52.987855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476644d-563a-4f92-bd62-25252100db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:53.004143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c476644d-563a-4f92-bd62-25252100db07 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:53.005360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c476644d-563a-4f92-bd62-25252100db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:53.070566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 552/1100] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:53.094507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc4644-0b6b-4c7b-ba8b-57847dd246e7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:53.157838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:53.197833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc4644-0b6b-4c7b-ba8b-57847dd246e7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:53.232589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:53.232950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:53.233232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:53.233505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:53.243740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:16:53.251372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:16:53.252590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:16:53.253677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 549/1101] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:16:53.258572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476644d-563a-4f92-bd62-25252100db07 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:53.285898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:53.356957 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476644d-563a-4f92-bd62-25252100db07 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:53.389427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:53.390051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:53.390336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:53.390614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:53.391348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:53.391657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:53.393063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:53.400936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 553/1102] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:16:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:53.407248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:53.504470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baa2be-bd1d-4fd6-b201-8fe990ba6ab0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:53.526385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:53.538054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:53.539558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:53.539558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:53.539558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] PATH_INFO: `/v3/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:53.540793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] RBAC: Authorizing `identity:get_user(user_id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:53.542241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:53.544143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 550/1103] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:16:53 2022] GET /identity/v3/users/4be7fcc1a4f643c19c9cd2e7a6fd3bbf => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:53.550018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:53.636449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:53.648114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7d4a-a230-4774-a174-3730bb0ff62e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:53.680781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:53.681417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:53.681696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:53.681967 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:53.750079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:53.751532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:53.832964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:53.845214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 554/1104] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:16:53.851089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:53.949270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf631923-3cba-4367-927e-0119ee65900c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:53.981449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8da969-8d07-40f0-8f36-f60270c7c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:53.982312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8da969-8d07-40f0-8f36-f60270c7c6ec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:53.983118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8da969-8d07-40f0-8f36-f60270c7c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:53.983398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8da969-8d07-40f0-8f36-f60270c7c6ec None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:53.984612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8da969-8d07-40f0-8f36-f60270c7c6ec None admin] RBAC: Authorizing `identity:get_project(project_id=651527a3032648eca8af465576cbb8a7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:53.986040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8da969-8d07-40f0-8f36-f60270c7c6ec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:53.987723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 551/1105] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:16:53 2022] GET /identity/v3/projects/651527a3032648eca8af465576cbb8a7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:53.993763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:54.089459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8e1e8-cf6c-4c01-bd84-cd6ac33e95e5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:54.121764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:54.122412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:54.122686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:54.122962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:54.124422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=651527a3032648eca8af465576cbb8a7, user.id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:16:54.124732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:54.126158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62421e9-e23c-470c-9544-53bd47716370 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:54.131902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 555/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:53 2022] GET /identity/v3/role_assignments?user.id=4be7fcc1a4f643c19c9cd2e7a6fd3bbf&scope.project.id=651527a3032648eca8af465576cbb8a7&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:56.363045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a80dc-10b9-4450-afc0-fa9411912573 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:56.363569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a80dc-10b9-4450-afc0-fa9411912573 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:56.363662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a80dc-10b9-4450-afc0-fa9411912573 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:56.365018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 552/1107] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:56.370233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:56.370661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:56.370799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:56.387962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:56.389212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:56.436554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:56.455478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 556/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:56.479669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a80dc-10b9-4450-afc0-fa9411912573 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:56.542319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:56.584863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a80dc-10b9-4450-afc0-fa9411912573 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:56.617770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1927f-4b45-4fec-8dc3-f180f7515402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:56.618551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1927f-4b45-4fec-8dc3-f180f7515402 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:56.618838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1927f-4b45-4fec-8dc3-f180f7515402 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:56.619117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1927f-4b45-4fec-8dc3-f180f7515402 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:56.620287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1927f-4b45-4fec-8dc3-f180f7515402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:56.621749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1927f-4b45-4fec-8dc3-f180f7515402 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:56.623387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 553/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:56.629198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:56.722827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc1843-740a-4662-82fb-e8e952fd51f3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:56.755823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8203-49ce-4d92-a461-3c25e27165c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:56.756520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8203-49ce-4d92-a461-3c25e27165c3 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:56.756808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8203-49ce-4d92-a461-3c25e27165c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:56.757087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8203-49ce-4d92-a461-3c25e27165c3 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:56.757786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8203-49ce-4d92-a461-3c25e27165c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:56.759237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8203-49ce-4d92-a461-3c25e27165c3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:56.866190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 557/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:16:56 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:16:59.092251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5e747-9eae-496c-b980-5969b2ad4213 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:59.092830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5e747-9eae-496c-b980-5969b2ad4213 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:59.092830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5e747-9eae-496c-b980-5969b2ad4213 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:59.094198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 554/1111] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:16:59.099583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:59.100006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:59.100152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:59.117279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:16:59.118483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:16:59.146594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:59.182769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 558/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:16:59.205952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5e747-9eae-496c-b980-5969b2ad4213 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:59.305774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5e747-9eae-496c-b980-5969b2ad4213 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:59.330854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:59.339049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:59.339900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:59.340186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:59.340493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] PATH_INFO: `/v3/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:59.342548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] RBAC: Authorizing `identity:get_role(role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:59.343852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:59.345262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 555/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:16:59 2022] GET /identity/v3/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:59.351246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:59.445892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe14e8-54cf-4d26-a83f-b819e270321f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:59.478797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:59.479653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:59.479930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:59.480200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] PATH_INFO: `/v3/users/3f5c34f67dc244f8ba97a4da00eca7d4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:59.492589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] RBAC: Authorizing `identity:get_user(user_id=3f5c34f67dc244f8ba97a4da00eca7d4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:59.494024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:59.495639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 559/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:16:59 2022] GET /identity/v3/users/3f5c34f67dc244f8ba97a4da00eca7d4 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:59.501444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:59.596770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f64ca-a3ae-44ba-b287-0cf70a4c9601 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:59.628288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:59.628951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:59.629230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:59.629502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:59.686434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:59.693433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:59.694871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:59.791391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 556/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:16:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:16:59.797613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:16:59.824363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:16:59.894194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe9138-b13f-4abd-9ff8-c4d54bcad04a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:16:59.926580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b2cf-95cd-4069-a295-b825c796ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:16:59.927432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b2cf-95cd-4069-a295-b825c796ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:16:59.927711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b2cf-95cd-4069-a295-b825c796ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:16:59.927983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b2cf-95cd-4069-a295-b825c796ecf0 None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:16:59.929186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4b2cf-95cd-4069-a295-b825c796ecf0 None admin] RBAC: Authorizing `identity:get_project(project_id=651527a3032648eca8af465576cbb8a7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:16:59.930621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4b2cf-95cd-4069-a295-b825c796ecf0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:16:59.932292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 560/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:16:59 2022] GET /identity/v3/projects/651527a3032648eca8af465576cbb8a7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:16:59.938984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:00.026661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:00.032755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070746-44bd-473e-8115-65fd2420a09f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:00.066314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:00.066954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:00.067235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:00.067509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:00.068351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] RBAC: Adding query filter params (role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=651527a3032648eca8af465576cbb8a7, user.id=3f5c34f67dc244f8ba97a4da00eca7d4) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:00.068656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:00.070063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b592f13-835f-4b98-81ad-2983f1c3b91a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:00.075313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 557/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:16:59 2022] GET /identity/v3/role_assignments?user.id=3f5c34f67dc244f8ba97a4da00eca7d4&scope.project.id=651527a3032648eca8af465576cbb8a7&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:02.252150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb26f8-fa7e-4f97-a3e0-9f69f5dd742e None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:02.252602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb26f8-fa7e-4f97-a3e0-9f69f5dd742e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:02.252731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb26f8-fa7e-4f97-a3e0-9f69f5dd742e None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:02.254095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 561/1118] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:02.259350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:02.259784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:02.259911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:02.276249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:02.277474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:02.342923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 558/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:02.365918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb26f8-fa7e-4f97-a3e0-9f69f5dd742e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:02.456955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:02.464215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb26f8-fa7e-4f97-a3e0-9f69f5dd742e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:02.497139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:02.498616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:02.498894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:02.499168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] PATH_INFO: `/v3/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:02.500904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] RBAC: Authorizing `identity:get_role(role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:02.502798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:02.504177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 562/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:02 2022] GET /identity/v3/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:02.510160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:02.599500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:02.611630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88afe-e30f-4cc7-b5d2-e8f5ccde0db7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:02.644699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:02.645570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:02.645857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:02.646136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] PATH_INFO: `/v3/users/3f5c34f67dc244f8ba97a4da00eca7d4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:02.647381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] RBAC: Authorizing `identity:get_user(user_id=3f5c34f67dc244f8ba97a4da00eca7d4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:02.648857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:02.650486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 559/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:02 2022] GET /identity/v3/users/3f5c34f67dc244f8ba97a4da00eca7d4 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:02.656787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:02.750861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eedc8-e2b8-4d0f-b113-89a0d8c39498 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:02.782700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ea3bd-6c1d-485d-8881-4d271eb441d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:02.783549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea3bd-6c1d-485d-8881-4d271eb441d6 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:02.783828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea3bd-6c1d-485d-8881-4d271eb441d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:02.784100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea3bd-6c1d-485d-8881-4d271eb441d6 None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:02.785298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ea3bd-6c1d-485d-8881-4d271eb441d6 None admin] RBAC: Authorizing `identity:get_project(project_id=651527a3032648eca8af465576cbb8a7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:02.786738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ea3bd-6c1d-485d-8881-4d271eb441d6 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:02.788564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 563/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:02 2022] GET /identity/v3/projects/651527a3032648eca8af465576cbb8a7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:02.794577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:02.891126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7e6a-32c2-467b-8c46-1feeb74d0e5f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:02.925809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efe86d-8225-4a2e-a610-09d04114027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:02.926703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe86d-8225-4a2e-a610-09d04114027e None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:02.926986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe86d-8225-4a2e-a610-09d04114027e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:02.927265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe86d-8225-4a2e-a610-09d04114027e None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7/users/3f5c34f67dc244f8ba97a4da00eca7d4/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:02.929527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efe86d-8225-4a2e-a610-09d04114027e None admin] RBAC: Authorizing `identity:create_grant(project_id=651527a3032648eca8af465576cbb8a7, user_id=3f5c34f67dc244f8ba97a4da00eca7d4, role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:02.930997 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efe86d-8225-4a2e-a610-09d04114027e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:03.016266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 560/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:17:02 2022] PUT /identity/v3/projects/651527a3032648eca8af465576cbb8a7/users/3f5c34f67dc244f8ba97a4da00eca7d4/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:17:05.220621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8dbbd-f593-4ba3-87c7-9729182fc4ec None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:05.221196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8dbbd-f593-4ba3-87c7-9729182fc4ec None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:05.221196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8dbbd-f593-4ba3-87c7-9729182fc4ec None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:05.222568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 564/1124] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:05.228350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:05.228795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:05.229056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:05.246951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:05.248239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:05.260076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:05.316051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 561/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:05.339491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8dbbd-f593-4ba3-87c7-9729182fc4ec None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:05.369135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:05.440990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8dbbd-f593-4ba3-87c7-9729182fc4ec None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:05.473248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f2362-6639-4015-becd-204a20be162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:05.474015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f2362-6639-4015-becd-204a20be162d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:05.474293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f2362-6639-4015-becd-204a20be162d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:05.474561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f2362-6639-4015-becd-204a20be162d None admin] PATH_INFO: `/v3/roles/ce0384d7ba5d440ab048e7c3c639fa37` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:05.476002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f2362-6639-4015-becd-204a20be162d None admin] RBAC: Authorizing `identity:get_role(role_id=ce0384d7ba5d440ab048e7c3c639fa37)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:05.477400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f2362-6639-4015-becd-204a20be162d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:05.478757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 565/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:05 2022] GET /identity/v3/roles/ce0384d7ba5d440ab048e7c3c639fa37 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:05.485172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:05.582470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40be30-b08d-428a-b446-4993933bc32d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:05.616652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:05.617524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:05.617809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:05.618087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] PATH_INFO: `/v3/users/3f5c34f67dc244f8ba97a4da00eca7d4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:05.619277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] RBAC: Authorizing `identity:get_user(user_id=3f5c34f67dc244f8ba97a4da00eca7d4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:05.620749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:05.622543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 562/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:05 2022] GET /identity/v3/users/3f5c34f67dc244f8ba97a4da00eca7d4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:05.628112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f2362-6639-4015-becd-204a20be162d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:05.721702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:05.725701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f2362-6639-4015-becd-204a20be162d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:05.759056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:05.759691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:05.759973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:05.760248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:05.828979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:05.830429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:05.924977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:05.929754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 566/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:17:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:17:05.935708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:05.951982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:06.034692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819c9a-2b35-4f90-ab80-e1d7f35a18fd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:06.067129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad339-832f-4d04-b0b4-6a455c68aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:06.067981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad339-832f-4d04-b0b4-6a455c68aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:06.068266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad339-832f-4d04-b0b4-6a455c68aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:06.068568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad339-832f-4d04-b0b4-6a455c68aaa7 None admin] PATH_INFO: `/v3/projects/651527a3032648eca8af465576cbb8a7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:06.069740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad339-832f-4d04-b0b4-6a455c68aaa7 None admin] RBAC: Authorizing `identity:get_project(project_id=651527a3032648eca8af465576cbb8a7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:06.071165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad339-832f-4d04-b0b4-6a455c68aaa7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:06.072884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 563/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:05 2022] GET /identity/v3/projects/651527a3032648eca8af465576cbb8a7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:06.079481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:06.173095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e19b1-104b-4cc0-b99b-1e6dddf91a94 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:06.205805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:06.206446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:06.206726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:06.206995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:06.207808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] RBAC: Adding query filter params (role.id=ce0384d7ba5d440ab048e7c3c639fa37, scope.project.id=651527a3032648eca8af465576cbb8a7, user.id=3f5c34f67dc244f8ba97a4da00eca7d4) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:06.208113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:06.209564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55804cf-4f4a-49a9-86cd-59613b2169cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:06.215289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 567/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:17:06 2022] GET /identity/v3/role_assignments?user.id=3f5c34f67dc244f8ba97a4da00eca7d4&scope.project.id=651527a3032648eca8af465576cbb8a7&role.id=ce0384d7ba5d440ab048e7c3c639fa37 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:08.427039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574151-7a1a-4947-ab50-c532b2a54c13 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:08.427613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574151-7a1a-4947-ab50-c532b2a54c13 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:08.427613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574151-7a1a-4947-ab50-c532b2a54c13 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:08.428991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 564/1131] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:08.434406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:08.435403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:08.435585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:08.451879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:08.453105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:08.508024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:08.518359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 568/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:08.542541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574151-7a1a-4947-ab50-c532b2a54c13 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:08.624458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:08.642688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574151-7a1a-4947-ab50-c532b2a54c13 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:08.677356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f666d3-d62c-4913-89c8-79eee6faa07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:08.678145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f666d3-d62c-4913-89c8-79eee6faa07d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:08.678432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f666d3-d62c-4913-89c8-79eee6faa07d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:08.678711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f666d3-d62c-4913-89c8-79eee6faa07d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:08.679895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f666d3-d62c-4913-89c8-79eee6faa07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:08.681363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f666d3-d62c-4913-89c8-79eee6faa07d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:08.682984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 565/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:08.688969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:08.782943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2a7ae-2b07-4984-8bf6-b1844cc7276c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:08.815452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bcde0-68eb-4ba9-81a1-873f91a7297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:08.816100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bcde0-68eb-4ba9-81a1-873f91a7297d None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:08.816414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bcde0-68eb-4ba9-81a1-873f91a7297d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:08.816695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bcde0-68eb-4ba9-81a1-873f91a7297d None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:08.817387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bcde0-68eb-4ba9-81a1-873f91a7297d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:08.818835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bcde0-68eb-4ba9-81a1-873f91a7297d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:08.899685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 569/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:17:08 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:17:11.154893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad164-ab95-4799-9233-9cd06cae691b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:11.155429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad164-ab95-4799-9233-9cd06cae691b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:11.155429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad164-ab95-4799-9233-9cd06cae691b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:11.156843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 566/1135] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:17:11.162221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:11.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:11.162784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:11.188317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:11.189560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:11.229959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:11.255487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 570/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:11.280976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad164-ab95-4799-9233-9cd06cae691b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:11.378500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad164-ab95-4799-9233-9cd06cae691b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:11.412204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a6212-3d4e-4f8a-a4f8-51e32500f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:11.412934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6212-3d4e-4f8a-a4f8-51e32500f34e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:11.413214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6212-3d4e-4f8a-a4f8-51e32500f34e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:11.413486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6212-3d4e-4f8a-a4f8-51e32500f34e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:11.414646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a6212-3d4e-4f8a-a4f8-51e32500f34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:11.416067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a6212-3d4e-4f8a-a4f8-51e32500f34e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:11.417962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 567/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:11.423755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:11.520205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160973c-3f26-44cc-b9b4-7b8eee0a49f4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:11.554113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874ed1b-5e32-4df3-b1f9-437a84f442a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:11.554780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ed1b-5e32-4df3-b1f9-437a84f442a5 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:11.555063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ed1b-5e32-4df3-b1f9-437a84f442a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:11.555339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ed1b-5e32-4df3-b1f9-437a84f442a5 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:11.556035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874ed1b-5e32-4df3-b1f9-437a84f442a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:11.557512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874ed1b-5e32-4df3-b1f9-437a84f442a5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:11.660632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 571/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:17:11 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:17:13.895032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344917-c3f1-428b-a303-caf2b1213efc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:13.895606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344917-c3f1-428b-a303-caf2b1213efc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:13.895606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344917-c3f1-428b-a303-caf2b1213efc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:13.897033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 568/1139] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:13.902929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:13.904008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:13.904109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:13.922630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:13.923868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:13.949608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:13.995052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 572/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:14.018774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344917-c3f1-428b-a303-caf2b1213efc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:14.039038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:14.122343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344917-c3f1-428b-a303-caf2b1213efc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:14.155090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:14.155799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:14.156079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:14.156435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:14.166242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:17:14.174726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:14.175893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:17:14.181530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 569/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:14.182435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:14.277619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90424-4642-43cd-b40e-56d634d039f8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:14.310630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:14.311290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:14.311573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:14.311851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:14.312626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:14.312940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:14.314314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:14.322274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 573/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:14.328709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:14.405258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:14.427510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d149ef-d305-44f6-a2f0-cd07d77bbc01 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:14.460272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:14.461189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:14.461637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:14.462322 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] PATH_INFO: `/v3/users/4ed5dc0daa0342a087147e294ced6886` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:14.476018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] RBAC: Authorizing `identity:get_user(user_id=4ed5dc0daa0342a087147e294ced6886)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:14.477492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:14.479205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 570/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:14 2022] GET /identity/v3/users/4ed5dc0daa0342a087147e294ced6886 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:14.484965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:14.508735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:14.583323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b349ca8-e785-49d7-8c86-658071682297 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:14.615693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:14.616360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:14.616649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:14.616926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:14.681565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:14.682925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:14.705959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:14.777988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 574/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:17:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:17:14.783808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:14.880082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02235f0-c5e7-4614-8b58-9b92e28941f5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:14.912795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4628-37e4-409f-8801-7638933ba7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:14.913651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4628-37e4-409f-8801-7638933ba7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:14.913930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4628-37e4-409f-8801-7638933ba7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:14.914204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4628-37e4-409f-8801-7638933ba7d3 None admin] PATH_INFO: `/v3/projects/aeb28cdaef384699af25dbac5249b0d5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:14.915379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4628-37e4-409f-8801-7638933ba7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=aeb28cdaef384699af25dbac5249b0d5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:14.917117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4628-37e4-409f-8801-7638933ba7d3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:14.919330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 571/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:14 2022] GET /identity/v3/projects/aeb28cdaef384699af25dbac5249b0d5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:14.925356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:15.023696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bf7a8-bc74-4115-bb58-07fc76cc7157 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:15.045770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:15.057369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:15.058027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:15.058311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:15.058592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:15.060007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=aeb28cdaef384699af25dbac5249b0d5, user.id=4ed5dc0daa0342a087147e294ced6886) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:15.060337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:15.061783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d6e49-6132-41c3-a0e6-e10ba23d4483 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:15.067217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 575/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:17:14 2022] GET /identity/v3/role_assignments?user.id=4ed5dc0daa0342a087147e294ced6886&scope.project.id=aeb28cdaef384699af25dbac5249b0d5&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:17.231659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e879-9454-46f1-b7a0-df2993df7430 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:17.232227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e879-9454-46f1-b7a0-df2993df7430 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:17.232227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10e879-9454-46f1-b7a0-df2993df7430 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:17.233665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 572/1147] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:17.239709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da556-708a-4943-832f-602803244e71 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:17.240241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da556-708a-4943-832f-602803244e71 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:17.240393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da556-708a-4943-832f-602803244e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:17.257928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-743da556-708a-4943-832f-602803244e71 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:17.259163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-743da556-708a-4943-832f-602803244e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:17.331203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 576/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:17.354945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10e879-9454-46f1-b7a0-df2993df7430 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:17.358935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:17.460018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10e879-9454-46f1-b7a0-df2993df7430 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:17.492979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:17.493697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:17.493980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:17.494253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:17.504051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:17:17.511724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:17.513407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:17:17.514390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 573/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:17.519547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da556-708a-4943-832f-602803244e71 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:17.614743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da556-708a-4943-832f-602803244e71 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:17.630884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:17.648233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:17.648921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:17.649201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:17.649473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:17.650203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:17.650507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:17.651866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:17.659669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 577/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:17.665841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:17.726735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:17.764575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f750f-cd3b-4c30-8a87-b1feaaf82599 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:17.796999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:17.797868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:17.798150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:17.798427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] PATH_INFO: `/v3/users/4ed5dc0daa0342a087147e294ced6886` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:17.799880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] RBAC: Authorizing `identity:get_user(user_id=4ed5dc0daa0342a087147e294ced6886)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:17.801338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:17.802965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 574/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:17 2022] GET /identity/v3/users/4ed5dc0daa0342a087147e294ced6886 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:17.808811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:17.904791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9a77f-3567-4138-b44a-dfb7981e43ad None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:17.937159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd010f2c-3b1e-4f21-b026-a6f71525959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:17.938006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010f2c-3b1e-4f21-b026-a6f71525959f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:17.938284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010f2c-3b1e-4f21-b026-a6f71525959f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:17.938558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd010f2c-3b1e-4f21-b026-a6f71525959f None admin] PATH_INFO: `/v3/projects/aeb28cdaef384699af25dbac5249b0d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:17.939708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd010f2c-3b1e-4f21-b026-a6f71525959f None admin] RBAC: Authorizing `identity:get_project(project_id=aeb28cdaef384699af25dbac5249b0d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:17.941176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd010f2c-3b1e-4f21-b026-a6f71525959f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:17.942832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 578/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:17 2022] GET /identity/v3/projects/aeb28cdaef384699af25dbac5249b0d5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:17.948808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:18.046504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec0f3-179a-4774-80e3-3f34f0cd23df None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:18.073998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:18.079397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fc57b-1a67-4889-92d0-900483a4c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:18.080289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc57b-1a67-4889-92d0-900483a4c660 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:18.080603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc57b-1a67-4889-92d0-900483a4c660 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:18.085938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc57b-1a67-4889-92d0-900483a4c660 None admin] PATH_INFO: `/v3/projects/aeb28cdaef384699af25dbac5249b0d5/users/4ed5dc0daa0342a087147e294ced6886/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:18.085938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fc57b-1a67-4889-92d0-900483a4c660 None admin] RBAC: Authorizing `identity:create_grant(project_id=aeb28cdaef384699af25dbac5249b0d5, user_id=4ed5dc0daa0342a087147e294ced6886, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:18.085938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fc57b-1a67-4889-92d0-900483a4c660 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:18.220335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 575/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:17:17 2022] PUT /identity/v3/projects/aeb28cdaef384699af25dbac5249b0d5/users/4ed5dc0daa0342a087147e294ced6886/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:17:20.421233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecde51-663e-48f6-a266-bdd016f610e8 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:20.421785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecde51-663e-48f6-a266-bdd016f610e8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:20.421785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecde51-663e-48f6-a266-bdd016f610e8 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:20.423134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 579/1154] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:20.428369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571adc48-174c-4126-8492-9105d491350f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:20.428819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571adc48-174c-4126-8492-9105d491350f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:20.428926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571adc48-174c-4126-8492-9105d491350f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:20.446118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-571adc48-174c-4126-8492-9105d491350f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:20.447309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-571adc48-174c-4126-8492-9105d491350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:20.516392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 576/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:20.539543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecde51-663e-48f6-a266-bdd016f610e8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:20.587087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:20.638981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecde51-663e-48f6-a266-bdd016f610e8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:20.672820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:20.673604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:20.673887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:20.674163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:20.683972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:17:20.691581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:20.692719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:20.693759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:17:20.696476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 580/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:20.698756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571adc48-174c-4126-8492-9105d491350f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:20.794618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571adc48-174c-4126-8492-9105d491350f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:20.816134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:20.827381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638938a5-738d-4232-9009-f71daeef99be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:20.828051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638938a5-738d-4232-9009-f71daeef99be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:20.829629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638938a5-738d-4232-9009-f71daeef99be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:20.829629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638938a5-738d-4232-9009-f71daeef99be None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:20.829629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638938a5-738d-4232-9009-f71daeef99be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:20.829973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638938a5-738d-4232-9009-f71daeef99be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:20.831096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638938a5-738d-4232-9009-f71daeef99be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:20.839188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 577/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:20.845503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:20.942660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f2128-8da8-4e15-bcfb-68b0967e4f7a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:20.950354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:20.976898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:20.977770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:20.978054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:20.978344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] PATH_INFO: `/v3/users/4ed5dc0daa0342a087147e294ced6886` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:20.979508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=4ed5dc0daa0342a087147e294ced6886)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:20.981004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:20.982620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 581/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:20 2022] GET /identity/v3/users/4ed5dc0daa0342a087147e294ced6886 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:20.988651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638938a5-738d-4232-9009-f71daeef99be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:21.088308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638938a5-738d-4232-9009-f71daeef99be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:21.120827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:21.121495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:21.121783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:21.122060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:21.171483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:21.186542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:21.187977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:21.285493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 578/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:17:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:17:21.291687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:21.389183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43664b-ee41-446d-b5fa-95c9e7e0d6b3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:21.421474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a866a-01dc-4768-958e-7cdb58cd0619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:21.422330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a866a-01dc-4768-958e-7cdb58cd0619 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:21.422616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a866a-01dc-4768-958e-7cdb58cd0619 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:21.422895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a866a-01dc-4768-958e-7cdb58cd0619 None admin] PATH_INFO: `/v3/projects/aeb28cdaef384699af25dbac5249b0d5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:21.424069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a866a-01dc-4768-958e-7cdb58cd0619 None admin] RBAC: Authorizing `identity:get_project(project_id=aeb28cdaef384699af25dbac5249b0d5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:21.425541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a866a-01dc-4768-958e-7cdb58cd0619 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:21.427222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 582/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:21 2022] GET /identity/v3/projects/aeb28cdaef384699af25dbac5249b0d5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:21.433383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:21.513730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:21.528734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da19b1-e1d9-466c-abb2-a6ce8b9a77fe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:21.561511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:21.562157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:21.562441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:21.562715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:21.563532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=aeb28cdaef384699af25dbac5249b0d5, user.id=4ed5dc0daa0342a087147e294ced6886) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:21.563845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:21.565288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381010f-d1c9-4c40-a4f0-2f6f91ffc422 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:21.570925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 579/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:17:21 2022] GET /identity/v3/role_assignments?user.id=4ed5dc0daa0342a087147e294ced6886&scope.project.id=aeb28cdaef384699af25dbac5249b0d5&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:23.791645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca64a8-bcb1-4d8f-a05d-ea05b6fb22e9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:23.792233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca64a8-bcb1-4d8f-a05d-ea05b6fb22e9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:23.792233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca64a8-bcb1-4d8f-a05d-ea05b6fb22e9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:23.793660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 583/1162] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:23.799154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:23.799580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:23.799706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:23.816579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:23.817755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:23.882105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 580/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:23.904626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca64a8-bcb1-4d8f-a05d-ea05b6fb22e9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:23.948494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:24.003886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca64a8-bcb1-4d8f-a05d-ea05b6fb22e9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:24.036676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:24.037243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:24.037528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:24.037806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:24.102323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:24.103710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:24.143562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:24.199688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 584/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:17:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:17:24.205980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:24.280704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:24.301717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74c06-83de-4266-864c-054a5ce54389 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:24.335070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:24.335864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:24.336144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:24.336447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:24.343498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:24.344966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e5a9c65c-1317-4809-bc61-834d174cf398 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:24.359317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:24.360629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:17:24.361738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 581/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:17:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:24.366498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:24.462884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4ba7a-8c9b-44da-a067-f464c88bf250 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:24.496550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:24.497210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:24.497496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:24.497776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:24.498494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:24.498805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:24.500195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905f410-3b75-4189-b669-238a8fb149d8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:24.507306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 585/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Fri May 27 09:17:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:26.700170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566435-4742-4cb3-b7f4-4561faa8085a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:26.700743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566435-4742-4cb3-b7f4-4561faa8085a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:26.700743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566435-4742-4cb3-b7f4-4561faa8085a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:26.702139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 582/1167] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:26.707354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4238f42-bc7a-450a-985b-b4533e52892e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:26.707774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4238f42-bc7a-450a-985b-b4533e52892e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:26.707915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4238f42-bc7a-450a-985b-b4533e52892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:26.719786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:26.725243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a4238f42-bc7a-450a-985b-b4533e52892e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:26.726440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a4238f42-bc7a-450a-985b-b4533e52892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:26.789726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 586/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:26.813224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75566435-4742-4cb3-b7f4-4561faa8085a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:26.915075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75566435-4742-4cb3-b7f4-4561faa8085a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:26.947718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fe9f0-0673-4ad6-b2e8-b4a0064c82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:26.948398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fe9f0-0673-4ad6-b2e8-b4a0064c82b2 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:26.948684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fe9f0-0673-4ad6-b2e8-b4a0064c82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:26.948960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fe9f0-0673-4ad6-b2e8-b4a0064c82b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:26.950269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fe9f0-0673-4ad6-b2e8-b4a0064c82b2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:26.951574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fe9f0-0673-4ad6-b2e8-b4a0064c82b2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:27.023678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:27.031907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 583/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Fri May 27 09:17:26 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:17:29.264134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa0e0-bc72-4613-8bed-d0f4312dd902 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:29.264669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa0e0-bc72-4613-8bed-d0f4312dd902 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:29.264770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa0e0-bc72-4613-8bed-d0f4312dd902 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:29.266120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 587/1170] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:29.271542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:29.271979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:29.272097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:29.288590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:29.289771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:29.355679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 584/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:17:29.379258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fa0e0-bc72-4613-8bed-d0f4312dd902 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:29.476301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fa0e0-bc72-4613-8bed-d0f4312dd902 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:29.509302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d331d-f18d-488c-9f17-5ecb34b2b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:29.510160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d331d-f18d-488c-9f17-5ecb34b2b81e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:29.510447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d331d-f18d-488c-9f17-5ecb34b2b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:29.510727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d331d-f18d-488c-9f17-5ecb34b2b81e None admin] PATH_INFO: `/v3/domains/86f510d1c0674831a63746d24ccae745` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:29.513751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:29.521754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d331d-f18d-488c-9f17-5ecb34b2b81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=86f510d1c0674831a63746d24ccae745)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:29.528413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d331d-f18d-488c-9f17-5ecb34b2b81e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:29.528413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 588/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Fri May 27 09:17:29 2022] GET /identity/v3/domains/86f510d1c0674831a63746d24ccae745 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:29.530689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:29.627144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b9b9e-37b8-4006-9644-e76d993e2d4e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:29.652802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:29.660403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb12687-c613-4d17-bdbf-c9a0acd62895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:29.671402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12687-c613-4d17-bdbf-c9a0acd62895 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:29.671402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12687-c613-4d17-bdbf-c9a0acd62895 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:29.671402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12687-c613-4d17-bdbf-c9a0acd62895 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:29.671402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb12687-c613-4d17-bdbf-c9a0acd62895 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:29.671402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb12687-c613-4d17-bdbf-c9a0acd62895 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:29.746624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 585/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:17:29 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:17:31.981275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e006-44ee-467d-92ce-1eb973bd2e8a None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:31.981807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e006-44ee-467d-92ce-1eb973bd2e8a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:31.981807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e006-44ee-467d-92ce-1eb973bd2e8a None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:31.983185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 589/1174] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:31.988385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:31.988786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:31.988952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:32.005892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:32.007074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:32.071830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 586/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:32.096798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e006-44ee-467d-92ce-1eb973bd2e8a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:32.194985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e006-44ee-467d-92ce-1eb973bd2e8a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:32.228124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fe916-4b27-4d27-811e-7be226b2f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:32.229022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe916-4b27-4d27-811e-7be226b2f30d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:32.229298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe916-4b27-4d27-811e-7be226b2f30d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:32.229568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe916-4b27-4d27-811e-7be226b2f30d None admin] PATH_INFO: `/v3/domains/86f510d1c0674831a63746d24ccae745` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:32.230803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fe916-4b27-4d27-811e-7be226b2f30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=86f510d1c0674831a63746d24ccae745)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:32.232243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fe916-4b27-4d27-811e-7be226b2f30d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:32.233877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 590/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Fri May 27 09:17:32 2022] GET /identity/v3/domains/86f510d1c0674831a63746d24ccae745 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:32.239598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:32.335142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18a4e-8364-488d-8d5a-84ec5e0f4743 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:32.345902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:32.367816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6ba3-354e-4f9c-83ed-6808dc20dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:32.368509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6ba3-354e-4f9c-83ed-6808dc20dcb9 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:32.368793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6ba3-354e-4f9c-83ed-6808dc20dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:32.369067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6ba3-354e-4f9c-83ed-6808dc20dcb9 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:32.369766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6ba3-354e-4f9c-83ed-6808dc20dcb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:32.371209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6ba3-354e-4f9c-83ed-6808dc20dcb9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:32.504589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 587/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:17:32 2022] POST /identity/v3/users => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:17:34.763730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549273c3-9aa6-429f-855a-eb13d9b845ab None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:34.764289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549273c3-9aa6-429f-855a-eb13d9b845ab None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:34.764289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549273c3-9aa6-429f-855a-eb13d9b845ab None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:34.765672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 591/1178] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:34.771010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:34.771417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:34.771562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:34.788588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:34.789764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:34.853658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 588/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:34.876943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549273c3-9aa6-429f-855a-eb13d9b845ab None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:34.938226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:34.975173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549273c3-9aa6-429f-855a-eb13d9b845ab None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:35.007773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:35.008582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:35.008866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:35.009137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:35.019896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:17:35.027519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:35.028802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:17:35.029846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 592/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:35.034771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:35.124796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:35.130189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0ed60-1a96-415b-b831-2c2ef7716784 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:35.164344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:35.165005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:35.165546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:35.165814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:35.166546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:35.166849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:35.168773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:35.176777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 589/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:17:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:35.182830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:35.281569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e46f0-ea47-4616-a3b8-fcc6149402bc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:35.306611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:35.317533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:35.328614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:35.328614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:35.328614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] PATH_INFO: `/v3/users/17656f00bb7c483b968063033a0e538c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:35.331953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] RBAC: Authorizing `identity:get_user(user_id=17656f00bb7c483b968063033a0e538c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:35.333461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:35.335144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 593/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:35 2022] GET /identity/v3/users/17656f00bb7c483b968063033a0e538c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:35.340933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:35.436898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828197-b26b-4b1b-b173-ddbec889dd57 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:35.468207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:35.468860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:35.469138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:35.469406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:35.496371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:35.534195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:35.535571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:35.631082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 590/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:17:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:17:35.637139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:35.734223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bca31-4809-46d5-9981-915c7633c8c0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:35.766242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74ef1-d2d4-4bb3-b7e5-5c9334c07680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:35.767102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74ef1-d2d4-4bb3-b7e5-5c9334c07680 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:35.767387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74ef1-d2d4-4bb3-b7e5-5c9334c07680 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:35.767664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74ef1-d2d4-4bb3-b7e5-5c9334c07680 None admin] PATH_INFO: `/v3/projects/57a3dee9769a4777a0a5c890f32ca6de` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:35.768853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc74ef1-d2d4-4bb3-b7e5-5c9334c07680 None admin] RBAC: Authorizing `identity:get_project(project_id=57a3dee9769a4777a0a5c890f32ca6de)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:35.770298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc74ef1-d2d4-4bb3-b7e5-5c9334c07680 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:35.772002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 594/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:35 2022] GET /identity/v3/projects/57a3dee9769a4777a0a5c890f32ca6de => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:35.778629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:35.834156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:35.874514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6e6be-db5a-4cfc-a80d-fc400ea4ec81 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:35.906889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:35.907534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:35.907818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:35.908093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:35.908945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=57a3dee9769a4777a0a5c890f32ca6de, user.id=17656f00bb7c483b968063033a0e538c) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:35.909255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:35.910665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14283f-79f4-4095-8cb1-9349b1e2879a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:35.916169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 591/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:17:35 2022] GET /identity/v3/role_assignments?user.id=17656f00bb7c483b968063033a0e538c&scope.project.id=57a3dee9769a4777a0a5c890f32ca6de&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:38.113847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4384-fe94-4ed5-b3e5-b1183cff3197 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.114407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4384-fe94-4ed5-b3e5-b1183cff3197 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.114407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4384-fe94-4ed5-b3e5-b1183cff3197 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.115794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 595/1186] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:38.121757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.122212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.122318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.139885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:38.141104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:38.211830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 592/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:38.235764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b4384-fe94-4ed5-b3e5-b1183cff3197 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:38.286302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:38.341455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b4384-fe94-4ed5-b3e5-b1183cff3197 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:38.375741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:38.376480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.376770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.377051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.387832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:17:38.395711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:38.396969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:38.398123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:17:38.400502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 596/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:38.403667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:38.457357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:38.503100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5b58c-4188-484e-811f-3a3fca6f4607 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:38.535945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:38.536643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.536925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.537199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.537938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:38.538244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:38.539614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:38.549061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 593/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:38.555204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:38.655147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342eb72-9eed-455e-a508-e90fdde30522 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:38.665750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:38.688938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:38.689875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.690156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.690436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] PATH_INFO: `/v3/users/17656f00bb7c483b968063033a0e538c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.691645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] RBAC: Authorizing `identity:get_user(user_id=17656f00bb7c483b968063033a0e538c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:38.693132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:38.694780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 597/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:38 2022] GET /identity/v3/users/17656f00bb7c483b968063033a0e538c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:38.700660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:38.803885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff13a-43ae-43d5-8fd2-78bf2c93046f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:38.817167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:38.836389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71f41-7f84-40ee-9cb5-e05d063b1e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:38.837259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71f41-7f84-40ee-9cb5-e05d063b1e37 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.837543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71f41-7f84-40ee-9cb5-e05d063b1e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.837818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71f41-7f84-40ee-9cb5-e05d063b1e37 None admin] PATH_INFO: `/v3/projects/57a3dee9769a4777a0a5c890f32ca6de` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.839563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71f41-7f84-40ee-9cb5-e05d063b1e37 None admin] RBAC: Authorizing `identity:get_project(project_id=57a3dee9769a4777a0a5c890f32ca6de)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:38.841095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71f41-7f84-40ee-9cb5-e05d063b1e37 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:38.842791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 594/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:38 2022] GET /identity/v3/projects/57a3dee9769a4777a0a5c890f32ca6de => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:38.848920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:38.946634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125f23c-20e6-4b45-8469-0e9be33318f5 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:38.979857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714e7e-079f-42aa-96d1-77840b79157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:38.980769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714e7e-079f-42aa-96d1-77840b79157b None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:38.981045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714e7e-079f-42aa-96d1-77840b79157b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:38.981313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714e7e-079f-42aa-96d1-77840b79157b None admin] PATH_INFO: `/v3/projects/57a3dee9769a4777a0a5c890f32ca6de/users/17656f00bb7c483b968063033a0e538c/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:38.983238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714e7e-079f-42aa-96d1-77840b79157b None admin] RBAC: Authorizing `identity:create_grant(project_id=57a3dee9769a4777a0a5c890f32ca6de, user_id=17656f00bb7c483b968063033a0e538c, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:38.984701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714e7e-079f-42aa-96d1-77840b79157b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:39.065018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 598/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:17:38 2022] PUT /identity/v3/projects/57a3dee9769a4777a0a5c890f32ca6de/users/17656f00bb7c483b968063033a0e538c/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:17:41.271406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74f9a-36be-436b-b149-0e8d70592a96 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:41.271944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74f9a-36be-436b-b149-0e8d70592a96 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:41.272042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74f9a-36be-436b-b149-0e8d70592a96 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:41.273391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 595/1193] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:17:41.279296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:41.279699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:41.279848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:41.296881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:17:41.298057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:17:41.326709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:41.364253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 599/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:17:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:17:41.387577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74f9a-36be-436b-b149-0e8d70592a96 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:41.496798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74f9a-36be-436b-b149-0e8d70592a96 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:41.530664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:41.531600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:41.531826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:41.532106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:41.544620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:17:41.552750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:17:41.554146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:17:41.555462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 596/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:17:41.561028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:41.662614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e5ce-aeab-4e2e-8ed5-49c8fadd400d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:41.697074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:41.697787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:41.698640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:41.698930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:41.699670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:41.699981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:41.701400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:41.709431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 600/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:41.715268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:41.757539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:41.813024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc2d08-31b8-413e-b421-ef97511f35ca None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:41.846434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:41.847307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:41.847593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:41.847867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] PATH_INFO: `/v3/users/17656f00bb7c483b968063033a0e538c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:41.849080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] RBAC: Authorizing `identity:get_user(user_id=17656f00bb7c483b968063033a0e538c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:41.850512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:41.852226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 597/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Fri May 27 09:17:41 2022] GET /identity/v3/users/17656f00bb7c483b968063033a0e538c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:41.858018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:41.889217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:41.962653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148ef84-e537-44ac-ae98-97e7b1e6e9fb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:42.000222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:42.000910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:42.001198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:42.001477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:42.074592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:42.075994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:42.107632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:42.179911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 601/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:17:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:17:42.186574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:42.287269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026faf-ed93-4343-9cc6-b6214842022d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:42.298571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:42.323256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16c96f-80e4-4325-a58a-cb1ca092f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:42.324122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16c96f-80e4-4325-a58a-cb1ca092f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:42.324439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16c96f-80e4-4325-a58a-cb1ca092f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:42.324770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16c96f-80e4-4325-a58a-cb1ca092f5d6 None admin] PATH_INFO: `/v3/projects/57a3dee9769a4777a0a5c890f32ca6de` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:42.325979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16c96f-80e4-4325-a58a-cb1ca092f5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=57a3dee9769a4777a0a5c890f32ca6de)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:42.327746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16c96f-80e4-4325-a58a-cb1ca092f5d6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:42.329764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 598/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Fri May 27 09:17:42 2022] GET /identity/v3/projects/57a3dee9769a4777a0a5c890f32ca6de => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:42.335864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:17:42.434782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8353b-b24c-4b45-89bb-b9eb4c9069ba None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:17:42.461525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:42.467878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:17:42.474018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:17:42.474018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:17:42.474018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:17:42.474018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=57a3dee9769a4777a0a5c890f32ca6de, user.id=17656f00bb7c483b968063033a0e538c) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:17:42.474018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:17:42.474018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cdfcd-c085-4b93-8db4-960113d920e4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:17:42.477566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 602/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:17:42 2022] GET /identity/v3/role_assignments?user.id=17656f00bb7c483b968063033a0e538c&scope.project.id=57a3dee9769a4777a0a5c890f32ca6de&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:17:52.333085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=11 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:17:52.493488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:07.004339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63760bb-7382-4bd7-999c-b684b52a89b8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:07.004991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63760bb-7382-4bd7-999c-b684b52a89b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:07.004991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63760bb-7382-4bd7-999c-b684b52a89b8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:07.006351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 599/1201] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:07.011714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:07.012170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:07.012279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:07.029604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:07.030796 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:07.099578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 603/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:07.124051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63760bb-7382-4bd7-999c-b684b52a89b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:07.225657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63760bb-7382-4bd7-999c-b684b52a89b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:07.260725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:07.261446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:07.261729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:07.262007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:07.273031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:07.274479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:07.292951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:07.294142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:07.295337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:07.295337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:07.295337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:07.295337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:07.295337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 600/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:07.300283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:07.400015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35111a06-3155-4d43-afc3-27b81f01067a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:07.429842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:07.435656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:07.436346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:07.436736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:07.437015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:07.437741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:07.438052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:07.439437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc71b7-658e-455d-80ec-54936084529e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:07.451185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 604/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:19:07.457928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:07.512520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:07.559621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58d1b-ab89-4fa5-976e-a68af3788dfa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:07.593531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e06c-9ecd-41ed-91b6-8c90f9a1c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:07.594208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e06c-9ecd-41ed-91b6-8c90f9a1c3fd None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:07.594490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e06c-9ecd-41ed-91b6-8c90f9a1c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:07.594764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e06c-9ecd-41ed-91b6-8c90f9a1c3fd None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:07.595464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7e06c-9ecd-41ed-91b6-8c90f9a1c3fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:07.596922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7e06c-9ecd-41ed-91b6-8c90f9a1c3fd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:07.719426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 601/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Fri May 27 09:19:07 2022] POST /identity/v3/users => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:19:09.969072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05180c6-3a56-4bea-bb4d-f1461f2ec355 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:09.969656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05180c6-3a56-4bea-bb4d-f1461f2ec355 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:09.969656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05180c6-3a56-4bea-bb4d-f1461f2ec355 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:09.971015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 605/1206] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:09.977325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:09.977869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:09.977869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:09.995447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:09.996681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:10.067692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 602/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:10.091462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05180c6-3a56-4bea-bb4d-f1461f2ec355 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:10.194254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05180c6-3a56-4bea-bb4d-f1461f2ec355 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:10.227036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:10.227758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:10.228036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:10.228306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:10.241180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:19:10.248950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:10.250077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:10.251175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 606/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:10.256751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:10.296134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:10.364565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35094aa-2844-455e-94bc-a6c3d1a3311e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:10.398909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:10.399586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:10.399871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:10.400135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:10.400917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:10.401223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:10.402598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:10.411285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 603/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:10.417152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:10.465678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:10.515273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba57d-d928-4d9f-a54f-b6ae5235ceca None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:10.550040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:10.551395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:10.555249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:10.555249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:10.562465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:10.563911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:10.580526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:10.581711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:10.582678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:10.582678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:10.582678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:10.582678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:10.582678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 607/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:10.587648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:10.690023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:10.692985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15fc4-9c64-4ead-8c61-efae78475928 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:10.725724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:10.726414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:10.726663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:10.726941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:10.727656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:10.727965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:10.729416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:10.741479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 604/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:19:10.747185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:10.845780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020abc9-ef74-4eff-ad9a-958db287ffbb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:10.847347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:10.883875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:10.884990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:10.885270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:10.885541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:10.893261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:10.895262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:19:10.911185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:10.912494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:10.913893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 608/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:10.918740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:11.016822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51358ca-529e-429b-b182-d5b5fe1840bc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:11.051484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:11.052148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:11.052454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:11.052726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:11.053605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:11.053955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:11.055376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:11.072312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 605/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Fri May 27 09:19:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:11.078128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:11.177078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff4c8-81fa-4e51-b4f4-e00bb7652ca0 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:11.210736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:11.211382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:11.211660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:11.211936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:11.242254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:11.281268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:11.282741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:11.387678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 609/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:19:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:19:11.393415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:11.414104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:11.497527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe2f1-0c12-4812-8e93-5eaf42bb448b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:11.532059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:11.535044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:11.535044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:11.535044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:11.545286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:11.546808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:11.565430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:11.566709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:11.567809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:11.567809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:11.567809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:11.567809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:11.567809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 606/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:11.572934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:11.635741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:11.674281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96455a-e505-4aed-8016-4e69046d81bb None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:11.706334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:11.707560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:11.707860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:11.708388 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:11.709114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:11.709589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:11.711111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:11.723724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 610/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:11.729506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:11.798218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:11.829416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aabfa-7077-4d70-9017-d03c77a40c79 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:11.866841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:11.867644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:11.867921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:11.868198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:11.874907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:11.876360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:19:11.890093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:11.895745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:11.896901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 607/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:11.898153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:11.999077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47b06-cbf0-48fe-80c2-99eea9039cbc None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:12.022042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:12.035314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:12.035992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:12.036275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:12.036584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:12.037368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:12.037679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:12.039222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c744-0e9a-456a-a146-8424f418f5e4 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:12.051946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 611/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:12.057955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:12.173388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc8d1-b584-4244-b8d3-c4c3974038ee None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:12.201076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:12.207870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:12.208552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:12.208833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:12.209107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:12.209930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=260ffef539f14b29b103ab0bfdeb0000) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:12.210239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:12.211656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9cdd7-30c3-42dc-8b63-21cdaa862b14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:12.217221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 608/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:19:12 2022] GET /identity/v3/role_assignments?user.id=260ffef539f14b29b103ab0bfdeb0000&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:19:14.480251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ac5dc-b2e1-4692-b21d-f67820ccf1db None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:14.480860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ac5dc-b2e1-4692-b21d-f67820ccf1db None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:14.480860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ac5dc-b2e1-4692-b21d-f67820ccf1db None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:14.482236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 612/1220] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:14.488214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:14.488832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:14.488832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:14.506066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:14.507294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:14.577147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 609/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:14.601834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ac5dc-b2e1-4692-b21d-f67820ccf1db None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:14.704282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ac5dc-b2e1-4692-b21d-f67820ccf1db None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:14.738688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:14.739413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:14.739698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:14.739973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:14.752193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:19:14.760207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:14.761473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:14.762751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 613/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:14.767543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:14.867764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc346d-24ab-46a1-8d99-bbd245f6bd6b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:14.893200 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:14.905220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:14.905903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:14.906186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:14.906461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:14.907214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:14.907519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:14.909180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:14.917912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 610/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:14.923904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:14.967642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:15.025606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df88d2-9497-4a14-8a6f-b8d539911cb8 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:15.059113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:15.059904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:15.060183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:15.060492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:15.070714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:15.072175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:15.088964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:15.090068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:15.091201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:15.091201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:15.091201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:15.091201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:15.091201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 614/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:15.096479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:15.197052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf93b4-fec4-415c-ad6a-0548e4f630db None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:15.230468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:15.231186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:15.231468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:15.231744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:15.232681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:15.232801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:15.234180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:15.246703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 611/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:15.252391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:15.345176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:15.352594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba5f38-6a51-4609-903b-c4b3ba95873b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:15.389289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:15.390087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:15.390476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:15.390757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:15.398315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:15.399766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:19:15.416699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:15.417817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:15.419065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 615/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:15.424183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:15.471112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:15.523219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3d2f1-e0b0-4995-befc-cd8f1a1b09ec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:15.557407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:15.558078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:15.558358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:15.558632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:15.559457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:15.559772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:15.561221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:15.577980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 612/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Fri May 27 09:19:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:15.584227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:15.682947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507abe-031e-4b87-8f62-53babe030bd1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:15.717090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:15.717887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:15.718172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:15.718556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:15.728926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:15.730409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:15.750142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:15.751216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:15.752359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:15.752359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:15.752359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:15.752359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:15.752359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 616/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:15.757860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:15.856300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae531b-87b0-4972-89c1-d146c3dbf3d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:15.858878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:15.891615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:15.892280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:15.892594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:15.892871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:15.893641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:15.894498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:15.895921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:15.907109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 613/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:15.913393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:15.922410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:16.014715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a228457-ff1b-4520-ab70-b0ae0457e6f7 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:16.049056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:16.050496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:16.050942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:16.051223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:16.058290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:16.071046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:19:16.074491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:16.075651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:16.076766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 617/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:16.081640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:16.181273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4eca-089c-4fa2-a2bc-dd5d1878bcd7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:16.216090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:16.216791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:16.217075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:16.217352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:16.218132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:16.218445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:16.219945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cc0ce-a6d5-47e5-95be-44f20bb794df None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:16.232650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 614/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:16.239216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:16.305551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:16.343239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cc1a-2457-4793-913d-d5033c066af3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:16.378954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1a449-6e42-484a-82e5-7596d9a44a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:16.379844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a449-6e42-484a-82e5-7596d9a44a6e None admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:16.380124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a449-6e42-484a-82e5-7596d9a44a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:16.380481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a449-6e42-484a-82e5-7596d9a44a6e None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/260ffef539f14b29b103ab0bfdeb0000/roles/adfaf7ea00d342ecab300f29cc2af15d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:16.395776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1a449-6e42-484a-82e5-7596d9a44a6e None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=260ffef539f14b29b103ab0bfdeb0000, role_id=adfaf7ea00d342ecab300f29cc2af15d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:16.397262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1a449-6e42-484a-82e5-7596d9a44a6e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:16.507213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 618/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:19:16 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/260ffef539f14b29b103ab0bfdeb0000/roles/adfaf7ea00d342ecab300f29cc2af15d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:19:18.730053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17ad73-5661-461e-a391-4d1975c61795 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:18.730615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17ad73-5661-461e-a391-4d1975c61795 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:18.730615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17ad73-5661-461e-a391-4d1975c61795 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:18.732010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 615/1233] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:18.738518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:18.738945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:18.739132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:18.757717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:18.769159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:18.833306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 619/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:18.857308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17ad73-5661-461e-a391-4d1975c61795 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:18.885161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:18.965186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17ad73-5661-461e-a391-4d1975c61795 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:18.999837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:19.000677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:19.000963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:19.001244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:19.012260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:19:19.020971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:19.022090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:19.023074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 616/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Fri May 27 09:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:19.028257 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:19.075211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:19.128734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f71d5-05de-4e83-823a-60676fab9d98 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:19.161840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:19.163973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:19.163973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:19.163973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:19.163973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] RBAC: Adding query filter params (name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:19.164316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:19.165429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:19.173294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 620/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Fri May 27 09:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:19.179708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:19.267635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:19.283080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6309d4-21b8-470e-8878-133bc3e5556c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:19.318425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:19.319226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:19.319509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:19.319835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:19.330297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:19.331773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:19.349519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:19.355147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:19.356173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:19.356173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:19.356173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:19.356173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:19.356173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 617/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:19.356690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:19.465042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585954c1-f020-4eae-8946-f3efca75478c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:19.476853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:19.505765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:19.506450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:19.506836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:19.506997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:19.507782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:19.508084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:19.509568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:19.524666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 621/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:19.530669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:19.647877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4496-964e-4de6-8dd5-8f0ccef5f35a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:19.695884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:19.697487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:19.697960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:19.698412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:19.702798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:19.711467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:19.713974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:19:19.732701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:19.734401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:19.735713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 618/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:19:19.740579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:19.842479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b645-9f5d-4a37-accb-93aed56cf386 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:19.879440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:19.880240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:19.880556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:19.880839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:19.881673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:19.881992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:19.883491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:19.901402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 622/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Fri May 27 09:19:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:19.907323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:20.009845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b73e-e31d-439d-814c-f8a3e8b41c57 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:20.044048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:20.044726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:20.045013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:20.045289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:20.105519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:20.112231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:20.113720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:20.208411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 619/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:19:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:19:20.214429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:20.242291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:20.314592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363de771-45fa-427a-b1e9-968bf9ceae95 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:20.349347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:20.350138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:20.350455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:20.350737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:20.360958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:20.362350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:20.380244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:20.381455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:20.382600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:20.382600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:20.382600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:20.382600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:20.382600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 623/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:20.387575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:20.487351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:20.493258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f8098-3c9a-4397-ac6a-125af63912fc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:20.528742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:20.529416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:20.529704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:20.529983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:20.530702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:20.531011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:20.532456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:20.544257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 620/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:20.550378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:20.628523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:20.649131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f76b-6c80-4920-96e9-c75c967f6510 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:20.682884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:20.683718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:20.683998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:20.684270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:20.691653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:20.693135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:19:20.707061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:20.713995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:20.715145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 624/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:20.716792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:20.821769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e911c-12f4-4bb4-b074-27146814cf17 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:20.855816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:20.856510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:20.863329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:20.863329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:20.863329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:20.863329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:20.863329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f463a9-8f49-40b5-bb8f-3493af871838 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:20.871831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 621/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:20.878111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:20.980086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75869-7693-4229-a624-1b014414cac1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:21.015559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:21.016205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:21.016525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:21.016808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:21.017637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] RBAC: Adding query filter params (role.id=adfaf7ea00d342ecab300f29cc2af15d, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=260ffef539f14b29b103ab0bfdeb0000) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:21.017952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:21.020036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed508b0-83cb-47f5-84e1-1b8775388119 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:21.026775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 625/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:19:20 2022] GET /identity/v3/role_assignments?user.id=260ffef539f14b29b103ab0bfdeb0000&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=adfaf7ea00d342ecab300f29cc2af15d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:23.301273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5f47-b35b-47f5-9e3d-19428998fafb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:23.301965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5f47-b35b-47f5-9e3d-19428998fafb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:23.301965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5f47-b35b-47f5-9e3d-19428998fafb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:23.303209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 622/1247] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:19:23.308955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:23.309385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:23.309540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:23.314478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:23.327262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:23.328573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:23.394623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 626/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:23.418955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5f47-b35b-47f5-9e3d-19428998fafb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:23.438585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:23.520806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5f47-b35b-47f5-9e3d-19428998fafb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:23.556255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:23.557092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:23.557377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:23.557691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:23.568281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:19:23.576159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:23.577176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:23.578068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 623/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:23.583931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:23.682781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623fdf-0e2a-45ea-83ec-9905870cac03 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:23.712097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:23.716959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:23.717634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:23.717899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:23.718168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:23.718897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:23.719200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:23.720592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:23.729267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 627/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:23.735078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:23.813083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:23.835500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c014-64fd-46b0-8d5b-6f7f39bf5900 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:23.867909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:23.868761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:23.869040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:23.869311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:23.879507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:23.880968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:23.898107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:23.899215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:23.900154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:23.900154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:23.900154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:23.900154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:23.900154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 624/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:23.905196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:24.004582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d902913-67f4-4ede-8223-df8bc56c99f1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:24.041134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:24.041811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:24.042096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:24.042369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:24.043091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:24.043407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:24.044870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:24.057035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 628/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:24.062866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:24.164894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0e69-aef6-4abd-8297-13c2d5927da4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:24.190785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:24.198436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:24.199254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:24.199538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:24.199816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:24.207793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:24.209296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:19:24.223356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:24.224558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:24.225557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 625/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:24.230598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:24.286585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:24.331155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3113-ddc4-4d85-9147-3c0a793c5633 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:24.364755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:24.365425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:24.365712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:24.365991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:24.366815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:24.367126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:24.368591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:24.385565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 629/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Fri May 27 09:19:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:24.391405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:24.500631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e152f7c-c6ae-47a2-8b02-aaa0d6d58d96 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:24.534973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:24.535621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:24.536279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:24.536279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:24.591473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:24.603553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:24.605038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:24.703546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 626/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:19:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:19:24.709403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:24.808223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201048f-e3a3-48ba-ab4c-53b911d88314 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:24.822457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:24.843172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:24.844046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:24.844351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:24.844642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:24.855495 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:24.857000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:24.875409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:24.876542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:24.878142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:24.878142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:24.878142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:24.878142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:24.878142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 630/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:24.882473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:24.975234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:24.987373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e08d0e-9f39-4cdf-9c10-6ea299487f07 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:25.021027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:25.021700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:25.021980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:25.022256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:25.022973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:25.023280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:25.024672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:25.036693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 627/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:25.042470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:25.142584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964efb9-6edc-4ba0-8ba7-958993db480b None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:25.177845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:25.178672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:25.178962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:25.179242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:25.186044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:25.187542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:19:25.201512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:25.202581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:25.203750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 631/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:25.209744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:25.320642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855fe34-d7a7-4a5e-921e-3526359dd21f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:25.357796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:25.358477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:25.358764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:25.359043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:25.359841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:25.360149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:25.361649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdf79-511d-4d9e-a4d8-d562862d9437 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:25.374803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 628/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:25.381070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:25.408217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:25.485487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d243-d662-4d7b-9608-8227e06afbe3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:25.521207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:25.521911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:25.522198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:25.522479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:25.523348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=260ffef539f14b29b103ab0bfdeb0000) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:25.523626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:25.525110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381249b-7039-487d-b153-2a5b24e515c8 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:25.530914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 632/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:19:25 2022] GET /identity/v3/role_assignments?user.id=260ffef539f14b29b103ab0bfdeb0000&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:27.764160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cded69-20f7-45da-a2ce-c9f98b260fdd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:27.764933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cded69-20f7-45da-a2ce-c9f98b260fdd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:27.764933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cded69-20f7-45da-a2ce-c9f98b260fdd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:27.766244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 629/1261] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:27.772554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:27.773110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:27.773110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:27.789958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:27.791229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:27.857128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 633/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:27.879897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cded69-20f7-45da-a2ce-c9f98b260fdd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:27.890887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:27.984708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cded69-20f7-45da-a2ce-c9f98b260fdd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.019901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.020656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.020939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.021211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:28.032779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:19:28.040608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:28.046195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:28.047294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 630/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:28.048624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:28.068096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:28.148236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e920c24-bcd7-49bb-a5ba-920bad10210c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.182155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.182818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.183478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.183478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:28.184096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:28.184432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:28.185907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:28.195215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 634/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:28.201127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:28.267768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:28.299864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72fee-f8ca-4f83-8753-307964c36400 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.332635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.333422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.333698 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.334012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:28.344950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:28.346377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:28.363861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:28.364957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:28.366252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:28.366252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:28.366252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:28.366252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:28.366252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 631/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:28.370979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:28.452183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:28.471583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29f951-36f3-4c9f-9741-a5318d36021d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.508465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.509148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.509429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.509703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:28.510501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:28.510818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:28.512395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:28.525088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 635/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:28.531068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:28.631563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa77b-2975-4a43-8932-830e7ddce5d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.650984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:28.665370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.666178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.666560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.666847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:28.675184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:28.676707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:19:28.691197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:28.700036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:28.701078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 632/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:28.701781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:28.797555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031f39-9198-4324-bf36-fbb217282170 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.832479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.837571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.837571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.837571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:28.837571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:28.837571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:28.837571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:28.847842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:28.855607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 636/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Fri May 27 09:19:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:28.861404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:28.962564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc09edc-3e08-4696-aea5-c2be2e9715f6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:28.996919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:28.997711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:28.997991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:28.998265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:29.009376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:29.010905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:29.028891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:29.030048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:29.031333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:29.031333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:29.031333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:29.031333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:29.031333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 633/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:19:29.036778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:29.134736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50722-ddee-4eee-998c-1e7a6530670e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:29.169778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:29.170439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:29.170724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:29.170999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:29.171710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:29.172016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:29.173471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:29.184596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 637/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:29.190765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:29.223551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:29.290826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbdb73-42ce-4a2f-9f92-5c141bfc63c3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:29.324153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:29.324984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:29.325270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:29.325546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:29.333652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:29.335146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:19:29.349544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:29.350711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:29.351776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 634/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:29.357064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:29.417542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:29.462828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cbc9c-5b0b-49f8-967a-e82cd00eb0af None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:29.495587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:29.496249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:29.496562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:29.496842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:29.497620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:29.497932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:29.499392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584eae-0262-46d3-bc54-66e772db20cf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:29.512735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 638/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:29.519464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:29.612113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:29.621687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdacf0-b0aa-4d1c-a40a-8c1d7c6c8762 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:29.655324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d164-acb0-4734-8842-f20658a2444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:29.656215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d164-acb0-4734-8842-f20658a2444a None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:29.656522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d164-acb0-4734-8842-f20658a2444a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:29.656794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d164-acb0-4734-8842-f20658a2444a None admin] PATH_INFO: `/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/260ffef539f14b29b103ab0bfdeb0000/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:29.659017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7d164-acb0-4734-8842-f20658a2444a None admin] RBAC: Authorizing `identity:create_grant(project_id=15f54360f1a44c26bd0122ca4da82a23, user_id=260ffef539f14b29b103ab0bfdeb0000, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:29.660669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7d164-acb0-4734-8842-f20658a2444a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:29.844657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 635/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Fri May 27 09:19:29 2022] PUT /identity/v3/projects/15f54360f1a44c26bd0122ca4da82a23/users/260ffef539f14b29b103ab0bfdeb0000/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:19:32.073095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683fde-f56f-4b48-a93f-72b488e90bba None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:32.073672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683fde-f56f-4b48-a93f-72b488e90bba None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:32.073672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683fde-f56f-4b48-a93f-72b488e90bba None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:32.075039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 639/1274] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:32.081357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:32.082864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:32.083158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:32.099933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:32.101164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:32.170846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 636/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:32.193115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad683fde-f56f-4b48-a93f-72b488e90bba None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:32.300960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad683fde-f56f-4b48-a93f-72b488e90bba None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:32.321528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:32.339696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:32.340446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:32.340730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:32.341006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:32.351223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:19:32.358870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:32.360050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:32.360991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 640/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Fri May 27 09:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:32.366278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:32.449459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:32.467692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136fde0-39ea-4ad8-a152-f3b1064c2679 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:32.502826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:32.503709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:32.504085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:32.504516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:32.505414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:32.505844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:32.507335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:32.516067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 637/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Fri May 27 09:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:32.522731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:32.636884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be678d2-0d23-43a0-8607-de5968d6239e None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:32.670672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:32.671466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:32.671749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:32.672024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:32.682932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:32.684401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:32.702439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:32.703643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:32.704702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:32.704702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:32.704702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:32.704702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:32.704702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 641/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:32.709763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:32.813086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230ccd9-25ac-43a0-9625-588db1346069 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:32.850098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:32.850793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:32.851084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:32.851361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:32.852194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:32.852538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:32.854100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:32.868189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 638/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:32.873979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:32.908421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:32.983439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0223-a1f0-4b41-b1d0-1b6707658f1a None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:33.019859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:33.020713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:33.020988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:33.021269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:33.029003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:33.030455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:19:33.046000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:33.047322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:33.048308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 642/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:33.053582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:33.057384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:33.152913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73180f-e262-42d5-8828-0c161e56c658 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:33.187070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:33.187659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:33.187942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:33.188218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:33.189103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:33.189408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:33.190840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:33.207929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 639/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Fri May 27 09:19:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:33.213918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:33.314587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:33.323917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8956f2-f071-4a0e-a6d2-742830c82a4d None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:33.358350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:33.358998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:33.359285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:33.359562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:33.429413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:33.430965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:33.519800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:33.530607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 643/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Fri May 27 09:19:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:19:33.538821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:33.600722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:33.638337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc726c-5def-43b7-b890-a4ecf3c0c76b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:33.677616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:33.678433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:33.678714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:33.678989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:33.691320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:33.692853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:19:33.712635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:33.717670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:33.719300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:19:33.719300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:19:33.719300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:19:33.719300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:33.719300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 640/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:33.720364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:33.830818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb842a10-bc81-4b8c-a851-edd1713c1fa3 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:33.866416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:33.867094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:33.867381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:33.867654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:33.868431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:33.868737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:33.870169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:33.883427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 644/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Fri May 27 09:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:33.889195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:34.000163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32b9e-f035-4bf1-a313-248808d43fac None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:34.016356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:34.037334 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:34.038147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:34.038439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:34.038720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:34.045941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:34.047402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:19:34.062745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:34.063856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:19:34.065558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: ERROR keystone.server.flask.application May 27 09:19:34.068486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 641/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Fri May 27 09:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:34.070578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:34.125379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:34.176434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736d60-dcf4-47ef-9298-7f239e5cabb1 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:34.209453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:34.210111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:34.210403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:34.210682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:34.211461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:34.211769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:34.213274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb13d-bbe2-4070-a0b7-47b90c9a2a6f None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:34.226305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 645/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Fri May 27 09:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:34.232550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:34.332637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a632-4223-4e7f-8e78-499614f8c706 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:34.366425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:34.367083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:34.367365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:34.367643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:34.368500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] RBAC: Adding query filter params (role.id=249bc5a9054543f2afcf80e8e211bc3c, scope.project.id=15f54360f1a44c26bd0122ca4da82a23, user.id=260ffef539f14b29b103ab0bfdeb0000) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:34.368820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:34.370240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6ec1-13e9-49d8-9e1d-6bb7b9e9c8be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:34.376164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 642/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Fri May 27 09:19:34 2022] GET /identity/v3/role_assignments?user.id=260ffef539f14b29b103ab0bfdeb0000&scope.project.id=15f54360f1a44c26bd0122ca4da82a23&role.id=249bc5a9054543f2afcf80e8e211bc3c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:36.605069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ebb3-ac44-490a-9e77-9435712228d7 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:36.605602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ebb3-ac44-490a-9e77-9435712228d7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:36.605690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ebb3-ac44-490a-9e77-9435712228d7 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:36.607070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 646/1288] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:36.612467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:36.612849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:36.613025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:36.629449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:36.630628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:36.660604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:36.696665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 643/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:36.719244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ebb3-ac44-490a-9e77-9435712228d7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:36.821005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ebb3-ac44-490a-9e77-9435712228d7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:36.832538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:36.859054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:36.859793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:36.860078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:36.860387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:36.861062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:36.862566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:36.875580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:36.877516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:36.878569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 647/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:19:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:36.883576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:36.981439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee102b2-58d0-4b66-bde6-484ff061d10e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:37.015602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:37.016263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:37.016577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:37.016885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:37.017598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:37.017903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:37.019481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3edb6-7c93-454b-94db-517ee88ab65d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:37.024280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 644/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Fri May 27 09:19:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:37.030017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:37.128679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80233-1a1d-48c1-9114-85807d0b0dbf None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:37.161469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:37.162118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:37.162404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:37.162683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] PATH_INFO: `/v3/services` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:37.163381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:37.163689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:37.165098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cf625-30b8-4792-8465-bb3072fd9f67 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:37.169451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 648/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Fri May 27 09:19:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:39.332028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26792587-bb63-4342-81df-b3dd026006d0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:39.332593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26792587-bb63-4342-81df-b3dd026006d0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:39.332692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26792587-bb63-4342-81df-b3dd026006d0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:39.334077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 645/1293] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:39.339324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc713-7839-4134-9a0d-0196688ecc96 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:39.339734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc713-7839-4134-9a0d-0196688ecc96 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:39.339878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc713-7839-4134-9a0d-0196688ecc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:39.356338 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ca6bc713-7839-4134-9a0d-0196688ecc96 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:39.357526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ca6bc713-7839-4134-9a0d-0196688ecc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:39.387293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:39.423223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 649/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:39.446218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26792587-bb63-4342-81df-b3dd026006d0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:39.476805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:39.547166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26792587-bb63-4342-81df-b3dd026006d0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:39.581012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6edb46-6d0a-4511-8d71-8a6cf69d189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:39.581676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edb46-6d0a-4511-8d71-8a6cf69d189b None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:39.581960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edb46-6d0a-4511-8d71-8a6cf69d189b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:39.582237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edb46-6d0a-4511-8d71-8a6cf69d189b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:39.583012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6edb46-6d0a-4511-8d71-8a6cf69d189b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:39.584406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6edb46-6d0a-4511-8d71-8a6cf69d189b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:39.690148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 646/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Fri May 27 09:19:39 2022] POST /identity/v3/services => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:19:41.892734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111e72-756c-44f6-bc03-81484ff6c12f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:41.893403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111e72-756c-44f6-bc03-81484ff6c12f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:41.893403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111e72-756c-44f6-bc03-81484ff6c12f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:41.894623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 650/1296] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:19:41.899920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:41.900347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:41.900529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:41.917852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:41.919037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:41.989579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 647/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:42.012721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19111e72-756c-44f6-bc03-81484ff6c12f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:42.112249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19111e72-756c-44f6-bc03-81484ff6c12f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:42.146389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:42.147116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:42.147396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:42.147669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:42.148311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:42.149719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:42.162641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:42.164109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:42.168293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 651/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:19:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:42.170115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:42.188722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:42.268338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591146d3-11c0-4e04-b606-c086c1735a1c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:42.301619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:42.302290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:42.302574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:42.302858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:42.303566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:42.303874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:42.305305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:42.310569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 648/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Fri May 27 09:19:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:42.317167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:42.347961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:42.413088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44079f4c-6926-4950-92cb-55d19c227863 None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:42.447611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:42.448255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:42.448568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:42.448849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:42.449624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] RBAC: Adding query filter params (interface=public, service_id=5bf6abbfb74f47ab9957805bf653611d, region_id=RegionOne) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:42.449935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:42.451301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da60c8-7365-43ff-8b14-b129d1c9abdf None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:42.456188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 652/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Fri May 27 09:19:42 2022] GET /identity/v3/endpoints?service_id=5bf6abbfb74f47ab9957805bf653611d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:42.461852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:42.543345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:42.561204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc939-decc-4a94-8763-611a4f484a53 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:42.593838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce336463-213c-449b-bd57-6e09ba802468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:42.596611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce336463-213c-449b-bd57-6e09ba802468 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:42.596611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce336463-213c-449b-bd57-6e09ba802468 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:42.596611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce336463-213c-449b-bd57-6e09ba802468 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:42.596611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce336463-213c-449b-bd57-6e09ba802468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:42.597258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce336463-213c-449b-bd57-6e09ba802468 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:42.603968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 649/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Fri May 27 09:19:42 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:19:44.811937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd40782-2536-41d3-bf12-e2c893fdce82 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:44.812524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd40782-2536-41d3-bf12-e2c893fdce82 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:44.812627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd40782-2536-41d3-bf12-e2c893fdce82 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:44.814077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 653/1302] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:19:44.819333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:44.819778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:44.819875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:44.836257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:19:44.837446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:19:44.901282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 650/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:19:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:19:44.924942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd40782-2536-41d3-bf12-e2c893fdce82 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:45.019310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:45.025861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd40782-2536-41d3-bf12-e2c893fdce82 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:45.058865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:45.061117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:45.061117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:45.061117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:45.061117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:45.062382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:19:45.074655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:19:45.075858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application with Lock( May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self._enter() May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application return self.creator() May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application created_value = creator( May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: ERROR keystone.server.flask.application May 27 09:19:45.076794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 654/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Fri May 27 09:19:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:19:45.082633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:45.158246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:45.180002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531be9-e48c-4953-9f97-e66685f40dcb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:45.212746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:45.213407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:45.213694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:45.213972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:45.214664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:19:45.214969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:45.216365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5eb3c-82f2-48ce-9739-c23d546d1fa5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:45.221570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 651/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Fri May 27 09:19:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:19:45.227612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:19:45.326557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df42cb-a794-4a1e-a257-1d92d5aff42c None admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:19:45.359334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816f0c-d7ed-45a7-a3d6-49d06c6f5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:19:45.360540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816f0c-d7ed-45a7-a3d6-49d06c6f5d19 None admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:19:45.360830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816f0c-d7ed-45a7-a3d6-49d06c6f5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:19:45.361105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816f0c-d7ed-45a7-a3d6-49d06c6f5d19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:19:45.361840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0816f0c-d7ed-45a7-a3d6-49d06c6f5d19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:19:45.363251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0816f0c-d7ed-45a7-a3d6-49d06c6f5d19 None admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:19:45.460476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 655/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Fri May 27 09:19:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:19:55.222471 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=30 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:19:55.455941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:30.632285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc3c66-96d0-4988-be34-78108b2ce712 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.632797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc3c66-96d0-4988-be34-78108b2ce712 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.632901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc3c66-96d0-4988-be34-78108b2ce712 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:30.639876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1024-bed7-422d-acdf-5c29f4c9fd80 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.640370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1024-bed7-422d-acdf-5c29f4c9fd80 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.640466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1024-bed7-422d-acdf-5c29f4c9fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:30.644757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 652/1307] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:30.718985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ec1d1024-bed7-422d-acdf-5c29f4c9fd80 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:30.720253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ec1d1024-bed7-422d-acdf-5c29f4c9fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:30.844792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 656/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:27:30.887123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfef0b-b0ce-4a21-aad2-5cb99aecec44 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.887410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfef0b-b0ce-4a21-aad2-5cb99aecec44 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.887694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfef0b-b0ce-4a21-aad2-5cb99aecec44 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:30.889211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 653/1309] 10.222.0.67 () {54 vars in 964 bytes} [Fri May 27 09:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:30.897560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1306d-592a-482c-af55-a430936290d2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.898145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1306d-592a-482c-af55-a430936290d2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.898571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1306d-592a-482c-af55-a430936290d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:31.023917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eff1306d-592a-482c-af55-a430936290d2 None None] MFA Rules not processed for user `76f6fdb7d7074ddba6170f110c750489`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:31.026181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eff1306d-592a-482c-af55-a430936290d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:31.051805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:31.112519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 657/1310] 10.222.0.67 () {58 vars in 1061 bytes} [Fri May 27 09:27:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:31.121520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfef0b-b0ce-4a21-aad2-5cb99aecec44 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:31.123491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5cbfef0b-b0ce-4a21-aad2-5cb99aecec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:31.247941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfef0b-b0ce-4a21-aad2-5cb99aecec44 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:31.333415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:31.334321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:31.334938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:31.335426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:31.337548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:31.411154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:31.479281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:31.480918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22218c12-4fcf-44c9-a3b7-d67d4bc93fad service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:31.504160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 654/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:34.100643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310c5e-34c2-4df3-8df0-297df523f0ac None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.101218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310c5e-34c2-4df3-8df0-297df523f0ac None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.101645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310c5e-34c2-4df3-8df0-297df523f0ac None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.104501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 658/1312] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:34.113164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd8e3-40f8-4e55-bef5-3234ae140f8b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.113674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd8e3-40f8-4e55-bef5-3234ae140f8b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.114412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd8e3-40f8-4e55-bef5-3234ae140f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.255629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-be8fd8e3-40f8-4e55-bef5-3234ae140f8b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:34.256996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be8fd8e3-40f8-4e55-bef5-3234ae140f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:34.375352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 655/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:34.413258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310c5e-34c2-4df3-8df0-297df523f0ac None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:34.414936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-db310c5e-34c2-4df3-8df0-297df523f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:34.551402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310c5e-34c2-4df3-8df0-297df523f0ac None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:34.638979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:34.641837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:34.643302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.643782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.644100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.646051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:34.770759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:34.772222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad4013-5831-4622-a220-c7c95850d29d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:34.792152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 659/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:37.741060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c002-9663-4585-a67f-6e42554f5a37 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:37.742180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c002-9663-4585-a67f-6e42554f5a37 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:37.742823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c002-9663-4585-a67f-6e42554f5a37 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:37.744382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 656/1315] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:37.750188 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ed1b5-89d1-4f81-86af-7754f148022e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:37.750649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ed1b5-89d1-4f81-86af-7754f148022e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:37.750773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ed1b5-89d1-4f81-86af-7754f148022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:37.821286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f87ed1b5-89d1-4f81-86af-7754f148022e None None] MFA Rules not processed for user `664e79cef1de4a619d1bcc1b9e9326ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:37.822496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f87ed1b5-89d1-4f81-86af-7754f148022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:37.891611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:37.939936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 660/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:37.979511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c002-9663-4585-a67f-6e42554f5a37 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:37.981068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4d4c002-9663-4585-a67f-6e42554f5a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:37.991538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:38.090509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c002-9663-4585-a67f-6e42554f5a37 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:38.166891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:38.167545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:38.167824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:38.168094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:38.169800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:38.234218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:38.289436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:38.290929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ac3b5-a069-40cf-9f15-465c93a0d524 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:38.313934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 657/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:41.380345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc441e-7609-41fa-8352-730de95c6cc2 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:41.380923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc441e-7609-41fa-8352-730de95c6cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:41.380923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc441e-7609-41fa-8352-730de95c6cc2 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:41.382279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 661/1318] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:41.387986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c45d32-aac7-4e44-b46a-ea85724a050f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:41.388472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c45d32-aac7-4e44-b46a-ea85724a050f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:41.388567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c45d32-aac7-4e44-b46a-ea85724a050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:41.458949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f3c45d32-aac7-4e44-b46a-ea85724a050f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:41.460195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3c45d32-aac7-4e44-b46a-ea85724a050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:41.557289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 658/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:41.595996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc441e-7609-41fa-8352-730de95c6cc2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:41.597607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-52cc441e-7609-41fa-8352-730de95c6cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:41.700195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc441e-7609-41fa-8352-730de95c6cc2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:41.780273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:41.780961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:41.781273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:41.781549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:41.783933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:41.792511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:41.905056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:41.906446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce10e-1bf3-4b7c-aad1-51ffaf6cc946 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:41.926582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 662/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:45.293427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897e8f8-8da7-4902-afe1-4dd342e8a62f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:45.293959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897e8f8-8da7-4902-afe1-4dd342e8a62f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:45.294073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897e8f8-8da7-4902-afe1-4dd342e8a62f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:45.295474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 659/1321] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:45.301749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157b6e5-f42f-4e72-8aa6-3435bb674f5b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:45.302254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157b6e5-f42f-4e72-8aa6-3435bb674f5b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:45.302345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157b6e5-f42f-4e72-8aa6-3435bb674f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:45.370213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5157b6e5-f42f-4e72-8aa6-3435bb674f5b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:45.371439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5157b6e5-f42f-4e72-8aa6-3435bb674f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:45.430961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:45.471038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 663/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:45.522417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30e76e-3a71-48d6-837f-03050ec1f616 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:45.522703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30e76e-3a71-48d6-837f-03050ec1f616 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:45.534769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30e76e-3a71-48d6-837f-03050ec1f616 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:45.534769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 660/1323] 10.222.0.67 () {54 vars in 964 bytes} [Fri May 27 09:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:45.535128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb87a-8c3c-494f-a670-ab002650bcce None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:45.535128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb87a-8c3c-494f-a670-ab002650bcce None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:45.535128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb87a-8c3c-494f-a670-ab002650bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:45.620436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f09eb87a-8c3c-494f-a670-ab002650bcce None None] MFA Rules not processed for user `76f6fdb7d7074ddba6170f110c750489`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:45.621634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f09eb87a-8c3c-494f-a670-ab002650bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:45.704177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 664/1324] 10.222.0.67 () {58 vars in 1061 bytes} [Fri May 27 09:27:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:27:45.714060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30e76e-3a71-48d6-837f-03050ec1f616 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:45.715599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aa30e76e-3a71-48d6-837f-03050ec1f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:45.738284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:45.824316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30e76e-3a71-48d6-837f-03050ec1f616 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:45.901234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:45.902140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:45.902426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:45.902707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:45.904429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:45.982409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:46.024271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:46.025744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc83143-11cd-4949-8b01-c6600ed47003 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:46.046374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 661/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:48.595392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c374-da52-4f00-952a-83ac54cee25f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:48.595934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c374-da52-4f00-952a-83ac54cee25f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:48.595934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c374-da52-4f00-952a-83ac54cee25f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:48.597379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 665/1326] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:48.602712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04cc0a-ce5b-409e-a860-412a5fcfd015 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:48.603137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04cc0a-ce5b-409e-a860-412a5fcfd015 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:48.603431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04cc0a-ce5b-409e-a860-412a5fcfd015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:48.669842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1d04cc0a-ce5b-409e-a860-412a5fcfd015 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:48.671044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1d04cc0a-ce5b-409e-a860-412a5fcfd015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:48.771675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 662/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:48.807566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c374-da52-4f00-952a-83ac54cee25f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:48.809164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-95c6c374-da52-4f00-952a-83ac54cee25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:48.872723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:48.918863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c374-da52-4f00-952a-83ac54cee25f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:48.995329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:48.995974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:48.996256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:48.996582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:48.998206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:49.116650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:49.119108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:49.120615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d8fbc-1862-4f91-b931-98beded3dc9e service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:49.140259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 666/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:51.447665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367161ad-4b74-472a-8967-6cde40cfc4d3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:51.448196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367161ad-4b74-472a-8967-6cde40cfc4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:51.448293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367161ad-4b74-472a-8967-6cde40cfc4d3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:51.449662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 663/1329] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:51.455136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2127b-a1d9-4927-acdc-dae1adffacd4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:51.455562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2127b-a1d9-4927-acdc-dae1adffacd4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:51.455696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2127b-a1d9-4927-acdc-dae1adffacd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:51.521604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-49a2127b-a1d9-4927-acdc-dae1adffacd4 None None] MFA Rules not processed for user `664e79cef1de4a619d1bcc1b9e9326ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:51.522818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-49a2127b-a1d9-4927-acdc-dae1adffacd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:51.618903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 667/1330] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:51.656214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367161ad-4b74-472a-8967-6cde40cfc4d3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:51.657891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-367161ad-4b74-472a-8967-6cde40cfc4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:51.687701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:51.760131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367161ad-4b74-472a-8967-6cde40cfc4d3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:51.832918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:51.833491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:51.833794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:51.834049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:51.835732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:51.914732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:51.950198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:51.951788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0245-a6f9-4c7b-bea8-d854450b7129 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:51.971142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 664/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:54.831448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b8b0-4fcb-4ab1-a342-c1e25527f9de None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:54.831928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b8b0-4fcb-4ab1-a342-c1e25527f9de None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:54.832011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b8b0-4fcb-4ab1-a342-c1e25527f9de None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:54.833444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 668/1332] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:54.839429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455e04d-4e2e-4803-bd98-d02beede1da6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:54.840132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455e04d-4e2e-4803-bd98-d02beede1da6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:54.840132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455e04d-4e2e-4803-bd98-d02beede1da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:54.911898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b455e04d-4e2e-4803-bd98-d02beede1da6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:54.913259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b455e04d-4e2e-4803-bd98-d02beede1da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:55.016284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 665/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:55.053342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4b8b0-4fcb-4ab1-a342-c1e25527f9de None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:55.054966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a6d4b8b0-4fcb-4ab1-a342-c1e25527f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:55.131694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:55.167947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4b8b0-4fcb-4ab1-a342-c1e25527f9de None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:55.245744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:55.246398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:55.246690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:55.246971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:55.248655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:55.364893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:55.366363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67e2f-e466-46a0-a767-9b6a5195e585 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:55.378090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:55.390033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 669/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:57.737440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79e31-9db9-4123-a1ca-e497f46d670b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:57.738056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79e31-9db9-4123-a1ca-e497f46d670b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:57.738056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79e31-9db9-4123-a1ca-e497f46d670b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:57.739400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 666/1335] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:27:57.745464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53afa8-b03b-4660-ae72-c824e7c80ecf None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:57.746034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53afa8-b03b-4660-ae72-c824e7c80ecf None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:57.746128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53afa8-b03b-4660-ae72-c824e7c80ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:57.817799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7b53afa8-b03b-4660-ae72-c824e7c80ecf None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:57.819061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7b53afa8-b03b-4660-ae72-c824e7c80ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:57.930450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 670/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:57.971430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac79e31-9db9-4123-a1ca-e497f46d670b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:57.972998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bac79e31-9db9-4123-a1ca-e497f46d670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:58.016207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:58.092996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac79e31-9db9-4123-a1ca-e497f46d670b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:58.173505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:58.174154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:58.174434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:58.174707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:58.176360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:58.262641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:58.288198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:58.289581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9336b-28cc-4c3e-b2fc-a8cb9f86b951 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:58.308389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 667/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:01.350128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1191-e138-4848-8efa-132f83fe89eb None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:01.350658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1191-e138-4848-8efa-132f83fe89eb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:01.350658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1191-e138-4848-8efa-132f83fe89eb None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:01.352057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 671/1338] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:01.357549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea122a-31fd-4a1f-829a-dabc4451ee8e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:01.357986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea122a-31fd-4a1f-829a-dabc4451ee8e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:01.358113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea122a-31fd-4a1f-829a-dabc4451ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:01.433100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e4ea122a-31fd-4a1f-829a-dabc4451ee8e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:01.434223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e4ea122a-31fd-4a1f-829a-dabc4451ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:01.539523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 668/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:01.576668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1191-e138-4848-8efa-132f83fe89eb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:01.579458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bd9e1191-e138-4848-8efa-132f83fe89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:01.663424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:01.678642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1191-e138-4848-8efa-132f83fe89eb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:01.682379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ce535-07f2-4ff0-929d-ee2289558b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:01.682877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce535-07f2-4ff0-929d-ee2289558b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:01.683266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce535-07f2-4ff0-929d-ee2289558b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:01.683515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ce535-07f2-4ff0-929d-ee2289558b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:01.694257 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ce535-07f2-4ff0-929d-ee2289558b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:01.695740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ce535-07f2-4ff0-929d-ee2289558b32 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:01.707157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 672/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:06.405759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542e86-980e-49c8-b4d5-4de0f9824f17 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:06.406417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542e86-980e-49c8-b4d5-4de0f9824f17 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:06.406417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542e86-980e-49c8-b4d5-4de0f9824f17 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:06.408624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 669/1341] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:06.414550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba8cac-923e-4f87-8a47-2837628f31b6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:06.415516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba8cac-923e-4f87-8a47-2837628f31b6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:06.415803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba8cac-923e-4f87-8a47-2837628f31b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:06.446920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e9ba8cac-923e-4f87-8a47-2837628f31b6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:06.448189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e9ba8cac-923e-4f87-8a47-2837628f31b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:06.539418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 673/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:06.579475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f542e86-980e-49c8-b4d5-4de0f9824f17 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:06.591059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f542e86-980e-49c8-b4d5-4de0f9824f17 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:06.594935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3af1c-96d2-4cf3-9176-44490f097dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:06.597385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3af1c-96d2-4cf3-9176-44490f097dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:06.597385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3af1c-96d2-4cf3-9176-44490f097dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:06.597385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3af1c-96d2-4cf3-9176-44490f097dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:06.605937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3af1c-96d2-4cf3-9176-44490f097dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:06.607379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3af1c-96d2-4cf3-9176-44490f097dc8 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:06.618120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 670/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:10.014928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c950f5-ba3d-43c9-80ed-d635b1847cd6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:10.015733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c950f5-ba3d-43c9-80ed-d635b1847cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:10.015733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c950f5-ba3d-43c9-80ed-d635b1847cd6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:10.017492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 674/1344] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:10.026661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad159093-56c2-4708-b988-74e88a90239e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:10.027233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad159093-56c2-4708-b988-74e88a90239e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:10.027569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad159093-56c2-4708-b988-74e88a90239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:10.052073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ad159093-56c2-4708-b988-74e88a90239e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:10.053328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ad159093-56c2-4708-b988-74e88a90239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:10.061744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 671/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:10.102885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c950f5-ba3d-43c9-80ed-d635b1847cd6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:10.114182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c950f5-ba3d-43c9-80ed-d635b1847cd6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:10.117904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5520267-df0a-40ab-b7b7-2e418a644db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:10.118555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520267-df0a-40ab-b7b7-2e418a644db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:10.118841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520267-df0a-40ab-b7b7-2e418a644db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:10.119127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520267-df0a-40ab-b7b7-2e418a644db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:10.135271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5520267-df0a-40ab-b7b7-2e418a644db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:10.137873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5520267-df0a-40ab-b7b7-2e418a644db7 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:10.156599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 675/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:15.273658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd02f5-93c6-4213-89ae-943c87b2eb9e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:15.274510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd02f5-93c6-4213-89ae-943c87b2eb9e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:15.274510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd02f5-93c6-4213-89ae-943c87b2eb9e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:15.276147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 672/1347] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:15.283069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f479df-74a8-4b9a-ad21-8636f0d826ee None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:15.283666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f479df-74a8-4b9a-ad21-8636f0d826ee None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:15.284011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f479df-74a8-4b9a-ad21-8636f0d826ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:15.311671 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f1f479df-74a8-4b9a-ad21-8636f0d826ee None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:15.313685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f1f479df-74a8-4b9a-ad21-8636f0d826ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:15.323104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 676/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:15.382401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd02f5-93c6-4213-89ae-943c87b2eb9e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:15.384214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-89cd02f5-93c6-4213-89ae-943c87b2eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:15.401178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd02f5-93c6-4213-89ae-943c87b2eb9e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:15.407515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414520fb-0011-46c1-8af5-46aa0a2e731f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:15.408687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414520fb-0011-46c1-8af5-46aa0a2e731f service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:15.409348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414520fb-0011-46c1-8af5-46aa0a2e731f service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:15.409868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414520fb-0011-46c1-8af5-46aa0a2e731f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:15.426587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414520fb-0011-46c1-8af5-46aa0a2e731f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:15.429372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414520fb-0011-46c1-8af5-46aa0a2e731f service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:15.447918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 673/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:21.582771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b25f1-9c6c-4d0f-8884-b6cd226b3367 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:21.582771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b25f1-9c6c-4d0f-8884-b6cd226b3367 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:21.583253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b25f1-9c6c-4d0f-8884-b6cd226b3367 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:21.584978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 677/1350] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:21.591093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fbabf-8e9e-4d90-a1c6-49ec4414012b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:21.591821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fbabf-8e9e-4d90-a1c6-49ec4414012b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:21.591821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fbabf-8e9e-4d90-a1c6-49ec4414012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:21.610273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:21.678169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bd1fbabf-8e9e-4d90-a1c6-49ec4414012b None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:21.679386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bd1fbabf-8e9e-4d90-a1c6-49ec4414012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:21.902752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 674/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:28:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:25.303765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=57 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:26.952234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff209e1-8544-4804-84ab-e780db3b9a13 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:26.953733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff209e1-8544-4804-84ab-e780db3b9a13 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:26.954244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff209e1-8544-4804-84ab-e780db3b9a13 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:26.956152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 678/1352] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:28:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:26.965155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065acbe-1b30-4c6e-966a-42670173ee0c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:26.966326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065acbe-1b30-4c6e-966a-42670173ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:26.966917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065acbe-1b30-4c6e-966a-42670173ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:26.994188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5065acbe-1b30-4c6e-966a-42670173ee0c None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:26.997508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5065acbe-1b30-4c6e-966a-42670173ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:27.017345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 675/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:28:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:29.111392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c0a3-7939-45a4-a13a-b276e3e29020 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:29.112053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c0a3-7939-45a4-a13a-b276e3e29020 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:29.112053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c0a3-7939-45a4-a13a-b276e3e29020 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:29.113651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 679/1354] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:29.120635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929abc29-4b2b-4593-b063-e1b5d57f21a5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:29.121191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929abc29-4b2b-4593-b063-e1b5d57f21a5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:29.121317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929abc29-4b2b-4593-b063-e1b5d57f21a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:29.152184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-929abc29-4b2b-4593-b063-e1b5d57f21a5 None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:29.154290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-929abc29-4b2b-4593-b063-e1b5d57f21a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:29.169666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 676/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:28:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:32.926988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a90832-2504-459a-9f34-52672169c517 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:32.927908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a90832-2504-459a-9f34-52672169c517 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:32.928468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a90832-2504-459a-9f34-52672169c517 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:32.931926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 680/1356] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:32.940441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acb4b7-8116-4b6e-9ab1-b47cdb9c52c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:32.944406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acb4b7-8116-4b6e-9ab1-b47cdb9c52c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:32.944406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acb4b7-8116-4b6e-9ab1-b47cdb9c52c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:32.965553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b3acb4b7-8116-4b6e-9ab1-b47cdb9c52c1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:32.967213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b3acb4b7-8116-4b6e-9ab1-b47cdb9c52c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:32.979467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 677/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:33.053769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda359-b6e8-4660-ad3d-66bcde40e88c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:33.054566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda359-b6e8-4660-ad3d-66bcde40e88c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:33.055002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda359-b6e8-4660-ad3d-66bcde40e88c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:33.056838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 681/1358] 10.222.0.67 () {54 vars in 961 bytes} [Fri May 27 09:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:33.066171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186acd5-e091-48d9-9b2a-cbaca2276d64 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:33.067143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186acd5-e091-48d9-9b2a-cbaca2276d64 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:33.068944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186acd5-e091-48d9-9b2a-cbaca2276d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:33.128090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6186acd5-e091-48d9-9b2a-cbaca2276d64 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:33.129717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6186acd5-e091-48d9-9b2a-cbaca2276d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:33.201679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:33.227388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 678/1359] 10.222.0.67 () {58 vars in 1058 bytes} [Fri May 27 09:28:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:33.237822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda359-b6e8-4660-ad3d-66bcde40e88c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:33.253053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda359-b6e8-4660-ad3d-66bcde40e88c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:33.258835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ded7e-cfcd-472e-b2ae-9c71dec2446a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:33.259597 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ded7e-cfcd-472e-b2ae-9c71dec2446a service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:33.259986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ded7e-cfcd-472e-b2ae-9c71dec2446a service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:33.260403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ded7e-cfcd-472e-b2ae-9c71dec2446a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:33.270391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ded7e-cfcd-472e-b2ae-9c71dec2446a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:33.272155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ded7e-cfcd-472e-b2ae-9c71dec2446a service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:33.283334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 682/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:35.806016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804e155-e658-445a-b834-2c2928b39432 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.806620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804e155-e658-445a-b834-2c2928b39432 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.806620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804e155-e658-445a-b834-2c2928b39432 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.807913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 679/1361] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:35.814109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01511fb8-6182-43cd-8070-b99af99d8fd8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.814663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01511fb8-6182-43cd-8070-b99af99d8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.814764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01511fb8-6182-43cd-8070-b99af99d8fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.834615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-01511fb8-6182-43cd-8070-b99af99d8fd8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:35.835813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-01511fb8-6182-43cd-8070-b99af99d8fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:35.844101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 683/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:35.888354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804e155-e658-445a-b834-2c2928b39432 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:35.905580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804e155-e658-445a-b834-2c2928b39432 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:35.911923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48ea56-32be-4ae2-b217-2f533b12841b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:35.912708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ea56-32be-4ae2-b217-2f533b12841b service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.912994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ea56-32be-4ae2-b217-2f533b12841b service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.913267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ea56-32be-4ae2-b217-2f533b12841b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.923090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48ea56-32be-4ae2-b217-2f533b12841b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:35.924780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48ea56-32be-4ae2-b217-2f533b12841b service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:35.935781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 680/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:38.763824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460755-e1a6-4554-919b-9cfb0c3ce72d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.764405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460755-e1a6-4554-919b-9cfb0c3ce72d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.765390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460755-e1a6-4554-919b-9cfb0c3ce72d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.767639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 684/1364] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:38.773410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeb990-6428-47a7-bc5d-c63306defc53 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.774160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeb990-6428-47a7-bc5d-c63306defc53 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.774160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeb990-6428-47a7-bc5d-c63306defc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.801979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-17aeb990-6428-47a7-bc5d-c63306defc53 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:38.803816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-17aeb990-6428-47a7-bc5d-c63306defc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:38.816231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 681/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:38.869229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850538e4-1f54-42de-92aa-89cbdf88e26d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.876561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850538e4-1f54-42de-92aa-89cbdf88e26d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.876561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850538e4-1f54-42de-92aa-89cbdf88e26d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.876561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 685/1366] 10.222.0.67 () {54 vars in 961 bytes} [Fri May 27 09:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:38.879990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2607-7ae9-4e2c-9ca9-da86531ddbb6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.880450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2607-7ae9-4e2c-9ca9-da86531ddbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.880870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2607-7ae9-4e2c-9ca9-da86531ddbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.909400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f52e2607-7ae9-4e2c-9ca9-da86531ddbb6 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:38.910631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f52e2607-7ae9-4e2c-9ca9-da86531ddbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:38.920345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 682/1367] 10.222.0.67 () {58 vars in 1058 bytes} [Fri May 27 09:28:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:38.929139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850538e4-1f54-42de-92aa-89cbdf88e26d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:38.944088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850538e4-1f54-42de-92aa-89cbdf88e26d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:38.949696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58369449-d0f3-40ac-a084-bf4de51b34d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:38.950414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58369449-d0f3-40ac-a084-bf4de51b34d2 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.950793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58369449-d0f3-40ac-a084-bf4de51b34d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.951137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58369449-d0f3-40ac-a084-bf4de51b34d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.960623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58369449-d0f3-40ac-a084-bf4de51b34d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:38.964359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58369449-d0f3-40ac-a084-bf4de51b34d2 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:38.973593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 686/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:41.580357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35267ae7-c25b-4521-a0fe-be834b6ff38f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:41.581175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35267ae7-c25b-4521-a0fe-be834b6ff38f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:41.581175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35267ae7-c25b-4521-a0fe-be834b6ff38f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:41.582620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 683/1369] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:41.588366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78221524-652d-4f64-bd34-82c73fa076da None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:41.588940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78221524-652d-4f64-bd34-82c73fa076da None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:41.588940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78221524-652d-4f64-bd34-82c73fa076da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:41.607649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-78221524-652d-4f64-bd34-82c73fa076da None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:41.609520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-78221524-652d-4f64-bd34-82c73fa076da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:41.618025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 687/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:41.663629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35267ae7-c25b-4521-a0fe-be834b6ff38f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:41.680159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35267ae7-c25b-4521-a0fe-be834b6ff38f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:41.688829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533456f4-d945-4ce1-ae87-2b2b5bcddb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:41.689594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533456f4-d945-4ce1-ae87-2b2b5bcddb9b service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:41.689878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533456f4-d945-4ce1-ae87-2b2b5bcddb9b service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:41.690184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533456f4-d945-4ce1-ae87-2b2b5bcddb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:41.699963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533456f4-d945-4ce1-ae87-2b2b5bcddb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:41.701599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533456f4-d945-4ce1-ae87-2b2b5bcddb9b service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:41.713521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 684/1371] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:42.163510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c76b4-c643-4645-97c6-fb03f4ffa245 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:42.163745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c76b4-c643-4645-97c6-fb03f4ffa245 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:42.164036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c76b4-c643-4645-97c6-fb03f4ffa245 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:42.166100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 688/1372] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:42.172764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958816-e6b5-488a-9ff9-bb4b45497add None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:42.174626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958816-e6b5-488a-9ff9-bb4b45497add None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:42.174626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958816-e6b5-488a-9ff9-bb4b45497add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:42.194996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4a958816-e6b5-488a-9ff9-bb4b45497add None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:42.197280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4a958816-e6b5-488a-9ff9-bb4b45497add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:42.208379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 685/1373] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:42.530151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8682bac-1351-4a2e-ad26-40fb2513ba2c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:42.530151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8682bac-1351-4a2e-ad26-40fb2513ba2c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:42.530151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8682bac-1351-4a2e-ad26-40fb2513ba2c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:42.532812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 689/1374] 10.222.0.67 () {54 vars in 963 bytes} [Fri May 27 09:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:42.539212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29324809-2f19-4724-be84-146eee3f3ee8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:42.539212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29324809-2f19-4724-be84-146eee3f3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:42.539212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29324809-2f19-4724-be84-146eee3f3ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:42.598125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-29324809-2f19-4724-be84-146eee3f3ee8 None None] MFA Rules not processed for user `bb1b0792dd6a41ba82c5d04a08596bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:42.599353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-29324809-2f19-4724-be84-146eee3f3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:42.676507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 686/1375] 10.222.0.67 () {58 vars in 1060 bytes} [Fri May 27 09:28:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:42.684448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8682bac-1351-4a2e-ad26-40fb2513ba2c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:42.698030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8682bac-1351-4a2e-ad26-40fb2513ba2c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:42.702548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac5d80-edb8-462f-bb72-48e1fee76806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:42.703219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac5d80-edb8-462f-bb72-48e1fee76806 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:42.703507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac5d80-edb8-462f-bb72-48e1fee76806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:42.703790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac5d80-edb8-462f-bb72-48e1fee76806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:42.714792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac5d80-edb8-462f-bb72-48e1fee76806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:42.717025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac5d80-edb8-462f-bb72-48e1fee76806 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:42.729716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 690/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:44.206870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47d510-6d87-4f42-9ea0-17831b7db1a9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.207674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47d510-6d87-4f42-9ea0-17831b7db1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.207828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47d510-6d87-4f42-9ea0-17831b7db1a9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.209387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 687/1377] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:44.215483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0bb29-e239-4ad4-9016-e60f150d0f7a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.216348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0bb29-e239-4ad4-9016-e60f150d0f7a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.216348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0bb29-e239-4ad4-9016-e60f150d0f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.239174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-32c0bb29-e239-4ad4-9016-e60f150d0f7a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:44.240471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-32c0bb29-e239-4ad4-9016-e60f150d0f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:44.248579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 691/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:44.296776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47d510-6d87-4f42-9ea0-17831b7db1a9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:44.322109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47d510-6d87-4f42-9ea0-17831b7db1a9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.331556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa229da8-1048-4ced-b69f-ee60472fcb9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.332586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229da8-1048-4ced-b69f-ee60472fcb9e service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.333074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229da8-1048-4ced-b69f-ee60472fcb9e service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.333561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229da8-1048-4ced-b69f-ee60472fcb9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.347191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa229da8-1048-4ced-b69f-ee60472fcb9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:44.348941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa229da8-1048-4ced-b69f-ee60472fcb9e service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:44.359782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 688/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:46.879905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3fe4-a75a-479c-b872-be80cdb12824 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:46.880976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3fe4-a75a-479c-b872-be80cdb12824 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:46.881734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3fe4-a75a-479c-b872-be80cdb12824 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:46.883844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 692/1380] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:46.889901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76769-c292-48e7-898c-c67f4f82001f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:46.890858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76769-c292-48e7-898c-c67f4f82001f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:46.891401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76769-c292-48e7-898c-c67f4f82001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:46.911574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-82b76769-c292-48e7-898c-c67f4f82001f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:46.912830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-82b76769-c292-48e7-898c-c67f4f82001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:46.920942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 689/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:46.967842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f3fe4-a75a-479c-b872-be80cdb12824 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:46.983801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f3fe4-a75a-479c-b872-be80cdb12824 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:46.989752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604b9d8-df11-407e-8e90-f0c14c9be1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:46.990306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b9d8-df11-407e-8e90-f0c14c9be1a9 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:46.990779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b9d8-df11-407e-8e90-f0c14c9be1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:46.991206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b9d8-df11-407e-8e90-f0c14c9be1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:47.010766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604b9d8-df11-407e-8e90-f0c14c9be1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:47.012976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604b9d8-df11-407e-8e90-f0c14c9be1a9 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:47.026987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 693/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:49.910526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d838a-fd43-4597-8e65-be98881b9c91 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.911084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d838a-fd43-4597-8e65-be98881b9c91 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.911084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d838a-fd43-4597-8e65-be98881b9c91 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.914174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 690/1383] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:49.917900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52179ff4-1773-4271-8834-767508671bc3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.918524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52179ff4-1773-4271-8834-767508671bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.918524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52179ff4-1773-4271-8834-767508671bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.937193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-52179ff4-1773-4271-8834-767508671bc3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:49.938389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-52179ff4-1773-4271-8834-767508671bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:49.947864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 694/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:49.993107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d838a-fd43-4597-8e65-be98881b9c91 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:50.008764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d838a-fd43-4597-8e65-be98881b9c91 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:50.015660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d520b9-ca14-4ecc-b67c-4b4e879805a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:50.016351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d520b9-ca14-4ecc-b67c-4b4e879805a3 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.016635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d520b9-ca14-4ecc-b67c-4b4e879805a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.016907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d520b9-ca14-4ecc-b67c-4b4e879805a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.026532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d520b9-ca14-4ecc-b67c-4b4e879805a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:50.028129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d520b9-ca14-4ecc-b67c-4b4e879805a3 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:50.039423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 691/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:52.401617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091529-1d37-4cb8-b304-9b2d281925ef None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:52.402499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091529-1d37-4cb8-b304-9b2d281925ef None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:52.402806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091529-1d37-4cb8-b304-9b2d281925ef None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:52.404416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 695/1386] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:52.410697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88900fa-9cc4-4dfa-b734-aa017b3f23d0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:52.411528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88900fa-9cc4-4dfa-b734-aa017b3f23d0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:52.411528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88900fa-9cc4-4dfa-b734-aa017b3f23d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:52.431454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b88900fa-9cc4-4dfa-b734-aa017b3f23d0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:52.432787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b88900fa-9cc4-4dfa-b734-aa017b3f23d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:52.443638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 692/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:52.514555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091529-1d37-4cb8-b304-9b2d281925ef None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:52.537405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091529-1d37-4cb8-b304-9b2d281925ef None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:52.543099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593894f7-1e8c-42d7-a731-414875198973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:52.543976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593894f7-1e8c-42d7-a731-414875198973 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:52.543976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593894f7-1e8c-42d7-a731-414875198973 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:52.544457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593894f7-1e8c-42d7-a731-414875198973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:52.554511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593894f7-1e8c-42d7-a731-414875198973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:52.556519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593894f7-1e8c-42d7-a731-414875198973 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:52.567719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 696/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:55.018035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48bfdd-2f8f-48bf-8767-033df919fcc8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:55.018803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48bfdd-2f8f-48bf-8767-033df919fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:55.018803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48bfdd-2f8f-48bf-8767-033df919fcc8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:55.020002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 693/1389] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:55.030956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea60b-1f37-4721-92ac-223c4c28028f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:55.031639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea60b-1f37-4721-92ac-223c4c28028f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:55.032135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea60b-1f37-4721-92ac-223c4c28028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:55.062785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1ffea60b-1f37-4721-92ac-223c4c28028f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:55.065049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1ffea60b-1f37-4721-92ac-223c4c28028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:55.077039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 697/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:55.128170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48bfdd-2f8f-48bf-8767-033df919fcc8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:55.148498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48bfdd-2f8f-48bf-8767-033df919fcc8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:55.155507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6801b7b-c5b0-409a-8915-851da0beefa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:55.156186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801b7b-c5b0-409a-8915-851da0beefa0 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:55.156524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801b7b-c5b0-409a-8915-851da0beefa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:55.156818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801b7b-c5b0-409a-8915-851da0beefa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:55.166834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801b7b-c5b0-409a-8915-851da0beefa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:55.168526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801b7b-c5b0-409a-8915-851da0beefa0 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:55.180020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 694/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:57.866027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4cf22-b59e-4f52-9afd-aa8f227174fc None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:57.866668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4cf22-b59e-4f52-9afd-aa8f227174fc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:57.866668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4cf22-b59e-4f52-9afd-aa8f227174fc None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:57.868024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 698/1392] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:57.874895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6439e6-a289-4d5b-b11a-c96b59d17430 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:57.875520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6439e6-a289-4d5b-b11a-c96b59d17430 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:57.875520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6439e6-a289-4d5b-b11a-c96b59d17430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:57.901011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-df6439e6-a289-4d5b-b11a-c96b59d17430 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:57.902233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-df6439e6-a289-4d5b-b11a-c96b59d17430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:57.911743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 695/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:57.958297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4cf22-b59e-4f52-9afd-aa8f227174fc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:57.969390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=46 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:57.980183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4cf22-b59e-4f52-9afd-aa8f227174fc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:57.986642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7817c-c6b5-4af4-a5e3-61c6baecc919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:57.990461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7817c-c6b5-4af4-a5e3-61c6baecc919 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:57.990461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7817c-c6b5-4af4-a5e3-61c6baecc919 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:57.990461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7817c-c6b5-4af4-a5e3-61c6baecc919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:57.997107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7817c-c6b5-4af4-a5e3-61c6baecc919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:57.999280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7817c-c6b5-4af4-a5e3-61c6baecc919 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.009850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 699/1394] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:59.380175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8b8a-ca93-4ffd-af1b-68ad049bf543 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.380801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8b8a-ca93-4ffd-af1b-68ad049bf543 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.380801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8b8a-ca93-4ffd-af1b-68ad049bf543 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.382136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 696/1395] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:59.387522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22cd2-7f43-4e81-8e2e-ddccd4676103 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.388031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22cd2-7f43-4e81-8e2e-ddccd4676103 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.388151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22cd2-7f43-4e81-8e2e-ddccd4676103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.413653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ccb22cd2-7f43-4e81-8e2e-ddccd4676103 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:59.414872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ccb22cd2-7f43-4e81-8e2e-ddccd4676103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:59.423696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 700/1396] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:59.486856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd1b0-5c84-4649-b896-c36720532c90 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.487067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd1b0-5c84-4649-b896-c36720532c90 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.487345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd1b0-5c84-4649-b896-c36720532c90 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.488775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 697/1397] 10.222.0.67 () {54 vars in 962 bytes} [Fri May 27 09:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:59.493809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aad19-d05c-4fec-a780-daae7d9fca0a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.494109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aad19-d05c-4fec-a780-daae7d9fca0a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.494383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aad19-d05c-4fec-a780-daae7d9fca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.552290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-249aad19-d05c-4fec-a780-daae7d9fca0a None None] MFA Rules not processed for user `7a4af657aef94d1abff7bc9c10264832`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:59.553531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-249aad19-d05c-4fec-a780-daae7d9fca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:59.616419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 701/1398] 10.222.0.67 () {58 vars in 1059 bytes} [Fri May 27 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:59.623905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd1b0-5c84-4649-b896-c36720532c90 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:59.635349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd1b0-5c84-4649-b896-c36720532c90 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:59.641076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cae3f-537f-4d81-846e-91dc566747e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:59.642394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cae3f-537f-4d81-846e-91dc566747e8 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.642899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cae3f-537f-4d81-846e-91dc566747e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.643410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cae3f-537f-4d81-846e-91dc566747e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.657912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cae3f-537f-4d81-846e-91dc566747e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:59.663291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cae3f-537f-4d81-846e-91dc566747e8 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:59.670377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 698/1399] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:00.375668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe971a-a069-4f5d-95c2-5ce40b48157c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.376359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe971a-a069-4f5d-95c2-5ce40b48157c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.376541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe971a-a069-4f5d-95c2-5ce40b48157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.433382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-82fe971a-a069-4f5d-95c2-5ce40b48157c None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:00.434743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-82fe971a-a069-4f5d-95c2-5ce40b48157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:00.449548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63237-9a16-486b-8696-5e6d16f912d1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.450065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63237-9a16-486b-8696-5e6d16f912d1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.450180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63237-9a16-486b-8696-5e6d16f912d1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.452037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 699/1400] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:00.458383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.458809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.459450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.472877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:00.479597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:00.480850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:00.491027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 700/1401] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:00.509078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 702/1402] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:00.537643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:00.551858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947e0f-c5fd-478c-9181-f3e1a26a225e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:00.553574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ec2f4-1985-4343-934c-03baf7f01c68 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.553872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ec2f4-1985-4343-934c-03baf7f01c68 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.554158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ec2f4-1985-4343-934c-03baf7f01c68 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.555551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 703/1403] 10.222.0.67 () {54 vars in 942 bytes} [Fri May 27 09:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:29:00.559628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:00.560858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.561321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.561809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.565697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b9007-a80d-42ca-b6b8-cd1708f80e19 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.565986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b9007-a80d-42ca-b6b8-cd1708f80e19 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.566264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b9007-a80d-42ca-b6b8-cd1708f80e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.572294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:00.573910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:00.584466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 701/1404] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:00.628871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:00.631748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-237b9007-a80d-42ca-b6b8-cd1708f80e19 None None] MFA Rules not processed for user `7e8dcad979224353841afc735e1e7b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:00.632993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-237b9007-a80d-42ca-b6b8-cd1708f80e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:00.714989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 704/1405] 10.222.0.67 () {58 vars in 1039 bytes} [Fri May 27 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:00.724966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:00.737033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c20e2-620b-484d-90fa-bcdaf81c1686 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:00.742248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b7c4b-263d-4ced-bb44-3f046ff61fa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:00.742935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7c4b-263d-4ced-bb44-3f046ff61fa5 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:00.743239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7c4b-263d-4ced-bb44-3f046ff61fa5 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:00.743517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7c4b-263d-4ced-bb44-3f046ff61fa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:00.753966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b7c4b-263d-4ced-bb44-3f046ff61fa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:00.755567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b7c4b-263d-4ced-bb44-3f046ff61fa5 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:00.764047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 702/1406] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:29:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:29:03.162848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd825c-60e4-46cc-9cf7-f8d09fbefcea None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.163724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd825c-60e4-46cc-9cf7-f8d09fbefcea None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.163724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd825c-60e4-46cc-9cf7-f8d09fbefcea None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.165136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 705/1407] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:03.171701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14a24b-e2c2-466f-8571-d8ca0e5c447a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.172220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14a24b-e2c2-466f-8571-d8ca0e5c447a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.172350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14a24b-e2c2-466f-8571-d8ca0e5c447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.203291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1e14a24b-e2c2-466f-8571-d8ca0e5c447a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:03.204662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e14a24b-e2c2-466f-8571-d8ca0e5c447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:03.214515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 703/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:03.270981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd825c-60e4-46cc-9cf7-f8d09fbefcea None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.287286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd825c-60e4-46cc-9cf7-f8d09fbefcea None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.299184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6afa32-96d7-40e0-b418-d00e50479dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.299867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6afa32-96d7-40e0-b418-d00e50479dd6 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.300143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6afa32-96d7-40e0-b418-d00e50479dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.300463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6afa32-96d7-40e0-b418-d00e50479dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.319256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6afa32-96d7-40e0-b418-d00e50479dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.320951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6afa32-96d7-40e0-b418-d00e50479dd6 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.336104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 706/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:29:13.192397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=15 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:13.522337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=36 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:24.845473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961402c-3f49-4215-963d-3b8c5e062761 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:24.846074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961402c-3f49-4215-963d-3b8c5e062761 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:24.846180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961402c-3f49-4215-963d-3b8c5e062761 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:24.847617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 704/1410] 10.222.0.67 () {54 vars in 918 bytes} [Fri May 27 09:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:24.852813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec22f-f193-4c40-8177-7d2d6dc6d9bc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:24.853287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec22f-f193-4c40-8177-7d2d6dc6d9bc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:24.853387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec22f-f193-4c40-8177-7d2d6dc6d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:24.872207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-468ec22f-f193-4c40-8177-7d2d6dc6d9bc None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:24.873453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-468ec22f-f193-4c40-8177-7d2d6dc6d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:24.882112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 707/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Fri May 27 09:29:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:24.896456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fa42-eceb-40da-af5a-d91b93c931e0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:24.896752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fa42-eceb-40da-af5a-d91b93c931e0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:24.897034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fa42-eceb-40da-af5a-d91b93c931e0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:24.898732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 705/1412] 10.222.0.67 () {54 vars in 918 bytes} [Fri May 27 09:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:24.903617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc67-1c14-4a31-9442-2ed23225ccd5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:24.903904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc67-1c14-4a31-9442-2ed23225ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:24.904183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efc67-1c14-4a31-9442-2ed23225ccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:24.922302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-751efc67-1c14-4a31-9442-2ed23225ccd5 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:24.923488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-751efc67-1c14-4a31-9442-2ed23225ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:24.932425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 708/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Fri May 27 09:29:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:27.652006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f044d-24ab-44e2-b2d6-907424038767 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:27.653108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f044d-24ab-44e2-b2d6-907424038767 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:27.653108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f044d-24ab-44e2-b2d6-907424038767 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:27.654489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:27.659811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba8d1-337f-4ff2-88ff-d1a8be49db84 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:27.660211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba8d1-337f-4ff2-88ff-d1a8be49db84 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:27.660401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba8d1-337f-4ff2-88ff-d1a8be49db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:27.678611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2e4ba8d1-337f-4ff2-88ff-d1a8be49db84 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:27.679804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2e4ba8d1-337f-4ff2-88ff-d1a8be49db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:27.687590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:27.730527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f044d-24ab-44e2-b2d6-907424038767 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:27.744547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f044d-24ab-44e2-b2d6-907424038767 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:27.749950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deac02-e33e-4495-9385-fecf5bc406a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:27.750586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deac02-e33e-4495-9385-fecf5bc406a7 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:27.751422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deac02-e33e-4495-9385-fecf5bc406a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:27.751422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deac02-e33e-4495-9385-fecf5bc406a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:27.759925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deac02-e33e-4495-9385-fecf5bc406a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:27.761557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deac02-e33e-4495-9385-fecf5bc406a7 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:27.771692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 707/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:28.753875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7346c1-5622-43b0-8082-edecd3580568 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:28.754449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7346c1-5622-43b0-8082-edecd3580568 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:28.754449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7346c1-5622-43b0-8082-edecd3580568 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:28.755805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:28.760953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a2156-130c-4876-97fe-d02facb844e8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:28.761401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a2156-130c-4876-97fe-d02facb844e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:28.761504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a2156-130c-4876-97fe-d02facb844e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:28.780632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e38a2156-130c-4876-97fe-d02facb844e8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:28.781839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e38a2156-130c-4876-97fe-d02facb844e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:28.789705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:28.945022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7346c1-5622-43b0-8082-edecd3580568 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:28.959461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7346c1-5622-43b0-8082-edecd3580568 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:28.964911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49162-703a-4031-981b-216e41caba81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:28.966066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49162-703a-4031-981b-216e41caba81 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:28.966344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49162-703a-4031-981b-216e41caba81 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:28.966617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49162-703a-4031-981b-216e41caba81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:28.975689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49162-703a-4031-981b-216e41caba81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:28.977356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49162-703a-4031-981b-216e41caba81 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:28.988086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 711/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:29.928946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5114bf-1e93-4d45-ac1b-92339702550a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:29.929519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5114bf-1e93-4d45-ac1b-92339702550a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:29.929519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5114bf-1e93-4d45-ac1b-92339702550a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:29.930872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:29.936031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a671c29-5a8c-43e7-88ac-7b70110b1082 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:29.936511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a671c29-5a8c-43e7-88ac-7b70110b1082 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:29.936628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a671c29-5a8c-43e7-88ac-7b70110b1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:29.954844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3a671c29-5a8c-43e7-88ac-7b70110b1082 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:29.956035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3a671c29-5a8c-43e7-88ac-7b70110b1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:29.963820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:30.122230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5114bf-1e93-4d45-ac1b-92339702550a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:30.140128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5114bf-1e93-4d45-ac1b-92339702550a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:30.145915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7330-ff37-4742-9fd7-e102a9510261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:30.146563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7330-ff37-4742-9fd7-e102a9510261 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:30.146847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7330-ff37-4742-9fd7-e102a9510261 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:30.147168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7330-ff37-4742-9fd7-e102a9510261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:30.156638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb7330-ff37-4742-9fd7-e102a9510261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:30.158759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb7330-ff37-4742-9fd7-e102a9510261 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:30.170524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 710/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:31.082178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33a730-9bd9-4939-ab9c-8556c19a5098 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:31.082717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33a730-9bd9-4939-ab9c-8556c19a5098 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:31.082717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33a730-9bd9-4939-ab9c-8556c19a5098 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:31.084214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:31.089608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0536c75-238b-43fe-913c-0f788fadc201 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:31.091817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0536c75-238b-43fe-913c-0f788fadc201 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:31.091817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0536c75-238b-43fe-913c-0f788fadc201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:31.109215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a0536c75-238b-43fe-913c-0f788fadc201 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:31.110444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a0536c75-238b-43fe-913c-0f788fadc201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:31.118442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:31.266477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33a730-9bd9-4939-ab9c-8556c19a5098 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:31.281582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33a730-9bd9-4939-ab9c-8556c19a5098 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:31.286946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf29d4b-4ccb-4e5f-83a9-1f040a1f1deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:31.287579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf29d4b-4ccb-4e5f-83a9-1f040a1f1deb service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:31.287865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf29d4b-4ccb-4e5f-83a9-1f040a1f1deb service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:31.288146 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf29d4b-4ccb-4e5f-83a9-1f040a1f1deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:31.297125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf29d4b-4ccb-4e5f-83a9-1f040a1f1deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:31.298724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf29d4b-4ccb-4e5f-83a9-1f040a1f1deb service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:31.309285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 714/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:32.232665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30fa9c-2fcf-44b2-b51c-00fa765dcf8a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:32.233243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30fa9c-2fcf-44b2-b51c-00fa765dcf8a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:32.233243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30fa9c-2fcf-44b2-b51c-00fa765dcf8a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:32.234599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:29:32.240019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482dfc-73d6-40b8-abe4-2ef267b87bd0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:32.240520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482dfc-73d6-40b8-abe4-2ef267b87bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:32.240619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482dfc-73d6-40b8-abe4-2ef267b87bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:32.259012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2b482dfc-73d6-40b8-abe4-2ef267b87bd0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:32.260212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2b482dfc-73d6-40b8-abe4-2ef267b87bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:32.268014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:32.418886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30fa9c-2fcf-44b2-b51c-00fa765dcf8a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:32.433458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30fa9c-2fcf-44b2-b51c-00fa765dcf8a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:32.439524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5053cb-43aa-47d8-8ecd-fd03855bfe92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:32.440163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5053cb-43aa-47d8-8ecd-fd03855bfe92 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:32.440484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5053cb-43aa-47d8-8ecd-fd03855bfe92 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:32.440764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5053cb-43aa-47d8-8ecd-fd03855bfe92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:32.449575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5053cb-43aa-47d8-8ecd-fd03855bfe92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:32.451190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5053cb-43aa-47d8-8ecd-fd03855bfe92 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:32.461078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 713/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:33.395929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399834da-123d-48fe-98b4-3d45334360be None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:33.396524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399834da-123d-48fe-98b4-3d45334360be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:33.396650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399834da-123d-48fe-98b4-3d45334360be None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:33.398352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:29:33.404194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b708e4f-0ee9-4b15-a7ba-48e49761f909 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:33.404691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b708e4f-0ee9-4b15-a7ba-48e49761f909 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:33.404786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b708e4f-0ee9-4b15-a7ba-48e49761f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:33.423789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3b708e4f-0ee9-4b15-a7ba-48e49761f909 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:33.425071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b708e4f-0ee9-4b15-a7ba-48e49761f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:33.434479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:33.586577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399834da-123d-48fe-98b4-3d45334360be None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:33.600946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399834da-123d-48fe-98b4-3d45334360be None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:33.606518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f702-56e2-4f6b-8d35-76e791fef835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:33.607164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f702-56e2-4f6b-8d35-76e791fef835 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:33.607477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f702-56e2-4f6b-8d35-76e791fef835 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:33.607757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f702-56e2-4f6b-8d35-76e791fef835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:33.616593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8f702-56e2-4f6b-8d35-76e791fef835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:33.618202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8f702-56e2-4f6b-8d35-76e791fef835 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:33.628739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 717/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:34.547242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e491f31-c61c-49b6-bf92-4199f37ce766 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:34.547792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e491f31-c61c-49b6-bf92-4199f37ce766 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:34.547792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e491f31-c61c-49b6-bf92-4199f37ce766 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:34.549217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:34.554377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8c99-2260-429c-ac5b-54947f8e4ff3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:34.554828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8c99-2260-429c-ac5b-54947f8e4ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:34.554924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8c99-2260-429c-ac5b-54947f8e4ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:34.573200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-095c8c99-2260-429c-ac5b-54947f8e4ff3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:34.574435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-095c8c99-2260-429c-ac5b-54947f8e4ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:34.582224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:34.733482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e491f31-c61c-49b6-bf92-4199f37ce766 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:34.747985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e491f31-c61c-49b6-bf92-4199f37ce766 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:34.753281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3badf-b522-4e08-a1b8-70aa3ea93140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:34.753915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3badf-b522-4e08-a1b8-70aa3ea93140 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:34.754191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3badf-b522-4e08-a1b8-70aa3ea93140 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:34.754465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3badf-b522-4e08-a1b8-70aa3ea93140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:34.763226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3badf-b522-4e08-a1b8-70aa3ea93140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:34.764969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3badf-b522-4e08-a1b8-70aa3ea93140 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:34.774888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 716/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:35.691745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144017a-99d6-4f22-abf5-bc051ddded09 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:35.692361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144017a-99d6-4f22-abf5-bc051ddded09 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:35.692361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144017a-99d6-4f22-abf5-bc051ddded09 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:35.693706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:35.698937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049073-332a-4805-abd3-41e9b810c271 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:35.700043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049073-332a-4805-abd3-41e9b810c271 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:35.700043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049073-332a-4805-abd3-41e9b810c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:35.719197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fa049073-332a-4805-abd3-41e9b810c271 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:35.720438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa049073-332a-4805-abd3-41e9b810c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:35.728546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:35.879984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144017a-99d6-4f22-abf5-bc051ddded09 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:35.894880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144017a-99d6-4f22-abf5-bc051ddded09 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:35.900712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3791cd-2da1-4ffe-add1-207360c85f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:35.901352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3791cd-2da1-4ffe-add1-207360c85f45 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:35.901636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3791cd-2da1-4ffe-add1-207360c85f45 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:35.901917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3791cd-2da1-4ffe-add1-207360c85f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:35.910775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3791cd-2da1-4ffe-add1-207360c85f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:35.912401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3791cd-2da1-4ffe-add1-207360c85f45 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:35.923904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 720/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:36.870426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b2bb3-dc93-47d2-88ab-453d556cffb3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:36.871041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b2bb3-dc93-47d2-88ab-453d556cffb3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:36.871192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b2bb3-dc93-47d2-88ab-453d556cffb3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:36.872628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:36.878807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503444-5418-4aef-b3d5-f0f9bfca6962 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:36.879361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503444-5418-4aef-b3d5-f0f9bfca6962 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:36.879361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503444-5418-4aef-b3d5-f0f9bfca6962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:36.900446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ca503444-5418-4aef-b3d5-f0f9bfca6962 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:36.901674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ca503444-5418-4aef-b3d5-f0f9bfca6962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:36.910153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:37.062874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b2bb3-dc93-47d2-88ab-453d556cffb3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:37.079467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b2bb3-dc93-47d2-88ab-453d556cffb3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:37.085137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64447-9309-4202-89bd-26ce8f3602a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:37.085801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64447-9309-4202-89bd-26ce8f3602a8 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:37.086086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64447-9309-4202-89bd-26ce8f3602a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:37.086367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64447-9309-4202-89bd-26ce8f3602a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:37.095458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64447-9309-4202-89bd-26ce8f3602a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:37.097185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64447-9309-4202-89bd-26ce8f3602a8 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:37.107872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 719/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:39.220344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33492f-819f-46f4-ace5-8bda791a1a86 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.220905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33492f-819f-46f4-ace5-8bda791a1a86 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.221022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33492f-819f-46f4-ace5-8bda791a1a86 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.222407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:39.228702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddf67-f12d-4865-9b9d-969ede529684 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.229275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddf67-f12d-4865-9b9d-969ede529684 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.229275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddf67-f12d-4865-9b9d-969ede529684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.249293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-accddf67-f12d-4865-9b9d-969ede529684 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:39.250547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-accddf67-f12d-4865-9b9d-969ede529684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:39.258680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:39.298207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33492f-819f-46f4-ace5-8bda791a1a86 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:39.310230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33492f-819f-46f4-ace5-8bda791a1a86 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:39.314112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3971a-277a-4fc3-88d8-a762e3408e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:39.314776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3971a-277a-4fc3-88d8-a762e3408e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.315064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3971a-277a-4fc3-88d8-a762e3408e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.315337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3971a-277a-4fc3-88d8-a762e3408e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.325838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3971a-277a-4fc3-88d8-a762e3408e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:39.327303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3971a-277a-4fc3-88d8-a762e3408e90 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:39.337638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 723/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:41.708244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85868d-9583-4aec-8753-76a3e272f266 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:41.708836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85868d-9583-4aec-8753-76a3e272f266 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:41.708836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85868d-9583-4aec-8753-76a3e272f266 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:41.710217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:41.716412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559b9e-2960-4187-ad9a-1e80d7458402 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:41.716856 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559b9e-2960-4187-ad9a-1e80d7458402 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:41.716982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559b9e-2960-4187-ad9a-1e80d7458402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:41.735508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0b559b9e-2960-4187-ad9a-1e80d7458402 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:41.736795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0b559b9e-2960-4187-ad9a-1e80d7458402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:41.744976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:41.783685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85868d-9583-4aec-8753-76a3e272f266 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:41.795653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85868d-9583-4aec-8753-76a3e272f266 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:41.799205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4f66e-a449-42cc-9eda-14463748a5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:41.799858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f66e-a449-42cc-9eda-14463748a5ad service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:41.800139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f66e-a449-42cc-9eda-14463748a5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:41.800447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f66e-a449-42cc-9eda-14463748a5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:41.810896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4f66e-a449-42cc-9eda-14463748a5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:41.812399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4f66e-a449-42cc-9eda-14463748a5ad service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:41.822831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 722/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:44.548769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a11ec1-a1a8-4112-83fb-cab9885251de None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:44.549419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a11ec1-a1a8-4112-83fb-cab9885251de None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:44.549419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a11ec1-a1a8-4112-83fb-cab9885251de None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:44.550708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:44.556026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4663bd-965f-427f-9ba0-59c29eeb03d8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:44.556522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4663bd-965f-427f-9ba0-59c29eeb03d8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:44.556633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4663bd-965f-427f-9ba0-59c29eeb03d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:44.574955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5d4663bd-965f-427f-9ba0-59c29eeb03d8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:44.576158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5d4663bd-965f-427f-9ba0-59c29eeb03d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:44.584001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:44.622697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a11ec1-a1a8-4112-83fb-cab9885251de None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:44.633364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a11ec1-a1a8-4112-83fb-cab9885251de None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:44.637069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aeb21-e62c-4907-aac1-24b98a6b3adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:44.637700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aeb21-e62c-4907-aac1-24b98a6b3adb service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:44.637985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aeb21-e62c-4907-aac1-24b98a6b3adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:44.638265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aeb21-e62c-4907-aac1-24b98a6b3adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:44.647568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aeb21-e62c-4907-aac1-24b98a6b3adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:44.649049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aeb21-e62c-4907-aac1-24b98a6b3adb service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:44.659213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 726/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:47.015421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8096b-eefd-4fff-8c74-3f6553d6402f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:47.016036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8096b-eefd-4fff-8c74-3f6553d6402f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:47.016036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8096b-eefd-4fff-8c74-3f6553d6402f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:47.017395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:47.023069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd91de-a69e-4f98-b696-a9e885c20cd8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:47.023533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd91de-a69e-4f98-b696-a9e885c20cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:47.023651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd91de-a69e-4f98-b696-a9e885c20cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:47.040991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-84dd91de-a69e-4f98-b696-a9e885c20cd8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:47.042209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-84dd91de-a69e-4f98-b696-a9e885c20cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:47.049889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:47.088627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8096b-eefd-4fff-8c74-3f6553d6402f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:47.099251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8096b-eefd-4fff-8c74-3f6553d6402f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:47.102944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789dd3d-fc8a-4bf4-9b53-a5fa67002dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:47.103599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789dd3d-fc8a-4bf4-9b53-a5fa67002dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:47.103877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789dd3d-fc8a-4bf4-9b53-a5fa67002dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:47.104108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789dd3d-fc8a-4bf4-9b53-a5fa67002dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:47.113155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789dd3d-fc8a-4bf4-9b53-a5fa67002dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:47.114576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789dd3d-fc8a-4bf4-9b53-a5fa67002dcc service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:47.124591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 725/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:49.413587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05084a7-224a-455e-a421-c592776de11d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:49.414171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05084a7-224a-455e-a421-c592776de11d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:49.414171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05084a7-224a-455e-a421-c592776de11d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:49.415511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:49.421389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd6582-17dd-4e00-9112-1aaa5ff75b12 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:49.421859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd6582-17dd-4e00-9112-1aaa5ff75b12 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:49.421965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd6582-17dd-4e00-9112-1aaa5ff75b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:49.439958 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-59fd6582-17dd-4e00-9112-1aaa5ff75b12 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:49.441250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-59fd6582-17dd-4e00-9112-1aaa5ff75b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:49.449622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:49.487125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05084a7-224a-455e-a421-c592776de11d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:49.498211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05084a7-224a-455e-a421-c592776de11d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:49.501801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71bd8-e4c3-42ba-b9a4-b7c572929bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:49.502441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71bd8-e4c3-42ba-b9a4-b7c572929bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:49.502724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71bd8-e4c3-42ba-b9a4-b7c572929bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:49.503001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71bd8-e4c3-42ba-b9a4-b7c572929bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:49.512376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c71bd8-e4c3-42ba-b9a4-b7c572929bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:49.513855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c71bd8-e4c3-42ba-b9a4-b7c572929bb5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:49.523677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 729/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:51.806872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26f3e-23d0-42fb-bf47-3846fe2c6622 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:51.807573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26f3e-23d0-42fb-bf47-3846fe2c6622 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:51.807573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26f3e-23d0-42fb-bf47-3846fe2c6622 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:51.809416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:29:51.814672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3481b7-499b-4159-8aef-091bf18c0a2d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:51.815092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3481b7-499b-4159-8aef-091bf18c0a2d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:51.815222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3481b7-499b-4159-8aef-091bf18c0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:51.832665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ad3481b7-499b-4159-8aef-091bf18c0a2d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:51.833874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad3481b7-499b-4159-8aef-091bf18c0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:51.841688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:51.879905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26f3e-23d0-42fb-bf47-3846fe2c6622 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:51.891147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26f3e-23d0-42fb-bf47-3846fe2c6622 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:51.894672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977882a-c2f9-45aa-8aac-f15982e9d58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:51.895305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977882a-c2f9-45aa-8aac-f15982e9d58b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:51.895589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977882a-c2f9-45aa-8aac-f15982e9d58b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:51.895866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977882a-c2f9-45aa-8aac-f15982e9d58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:51.905614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977882a-c2f9-45aa-8aac-f15982e9d58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:51.907036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977882a-c2f9-45aa-8aac-f15982e9d58b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:51.916462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 728/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:54.227502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1620cf-fede-4eaf-8c4e-a5464f880d9f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:54.228032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1620cf-fede-4eaf-8c4e-a5464f880d9f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:54.228115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1620cf-fede-4eaf-8c4e-a5464f880d9f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:54.230029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:54.235773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbe86-2ea3-4b0f-b5b8-aeeaa1bae242 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:54.236216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbe86-2ea3-4b0f-b5b8-aeeaa1bae242 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:54.236311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbe86-2ea3-4b0f-b5b8-aeeaa1bae242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:54.242333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=70 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:54.255051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c5cbe86-2ea3-4b0f-b5b8-aeeaa1bae242 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:54.256254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c5cbe86-2ea3-4b0f-b5b8-aeeaa1bae242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:54.264184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:54.301698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1620cf-fede-4eaf-8c4e-a5464f880d9f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:54.307185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=73 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:54.313800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1620cf-fede-4eaf-8c4e-a5464f880d9f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:54.318741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8892-02c4-4c59-88ac-ea6fc7a908c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:54.318741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8892-02c4-4c59-88ac-ea6fc7a908c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:54.318741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8892-02c4-4c59-88ac-ea6fc7a908c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:54.318741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8892-02c4-4c59-88ac-ea6fc7a908c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:54.328013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8892-02c4-4c59-88ac-ea6fc7a908c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:54.329862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8892-02c4-4c59-88ac-ea6fc7a908c1 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:54.340243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 732/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:56.612851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f72cc-9fdd-4514-a718-516bcbb92aa5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:56.613425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f72cc-9fdd-4514-a718-516bcbb92aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:56.613425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f72cc-9fdd-4514-a718-516bcbb92aa5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:56.614791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:56.621047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9f69-7e4e-4e59-a2c1-16bc2d81d5b4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:56.621508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9f69-7e4e-4e59-a2c1-16bc2d81d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:56.621617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9f69-7e4e-4e59-a2c1-16bc2d81d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:56.640212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e9bd9f69-7e4e-4e59-a2c1-16bc2d81d5b4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:56.641448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e9bd9f69-7e4e-4e59-a2c1-16bc2d81d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:56.649586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:56.687286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f72cc-9fdd-4514-a718-516bcbb92aa5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:56.698483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f72cc-9fdd-4514-a718-516bcbb92aa5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:56.702065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2faf-2938-4512-91ce-890767075f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:56.702700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2faf-2938-4512-91ce-890767075f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:56.702988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2faf-2938-4512-91ce-890767075f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:56.703284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2faf-2938-4512-91ce-890767075f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:56.712502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2faf-2938-4512-91ce-890767075f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:56.713939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2faf-2938-4512-91ce-890767075f56 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:56.723599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 731/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:59.038068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df112d1c-5438-4cc1-a65b-3ff2f664efe3 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:59.038667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df112d1c-5438-4cc1-a65b-3ff2f664efe3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:59.038667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df112d1c-5438-4cc1-a65b-3ff2f664efe3 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:59.040056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:29:59.046556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824bdc-1d51-415f-943a-63e85350065e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:59.047120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824bdc-1d51-415f-943a-63e85350065e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:59.047120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824bdc-1d51-415f-943a-63e85350065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:59.068714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d1824bdc-1d51-415f-943a-63e85350065e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:59.069949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d1824bdc-1d51-415f-943a-63e85350065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:59.079016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:59.117688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df112d1c-5438-4cc1-a65b-3ff2f664efe3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:59.128802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df112d1c-5438-4cc1-a65b-3ff2f664efe3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:59.132441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26461-b0b6-436f-b299-a5594e88808a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:59.133102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26461-b0b6-436f-b299-a5594e88808a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:59.133385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26461-b0b6-436f-b299-a5594e88808a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:59.133662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26461-b0b6-436f-b299-a5594e88808a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:59.143543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26461-b0b6-436f-b299-a5594e88808a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:59.145067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26461-b0b6-436f-b299-a5594e88808a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:59.156609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 735/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:01.393761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42513185-5bad-423f-b980-0b652ed2a94d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:01.394346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42513185-5bad-423f-b980-0b652ed2a94d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:01.394346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42513185-5bad-423f-b980-0b652ed2a94d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:01.395650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:01.401879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03375-94ee-4b4c-9198-68edbc4b94ff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:01.402327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03375-94ee-4b4c-9198-68edbc4b94ff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:01.402423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03375-94ee-4b4c-9198-68edbc4b94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:01.421343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2ce03375-94ee-4b4c-9198-68edbc4b94ff None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:01.422547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ce03375-94ee-4b4c-9198-68edbc4b94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:01.430516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:01.467208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42513185-5bad-423f-b980-0b652ed2a94d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:01.477984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42513185-5bad-423f-b980-0b652ed2a94d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:01.481597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f636ea6-c603-428d-ace9-d02948d9dfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:01.482234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f636ea6-c603-428d-ace9-d02948d9dfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:01.482517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f636ea6-c603-428d-ace9-d02948d9dfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:01.482793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f636ea6-c603-428d-ace9-d02948d9dfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:01.491892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f636ea6-c603-428d-ace9-d02948d9dfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:01.493342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f636ea6-c603-428d-ace9-d02948d9dfb6 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:01.502936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 734/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:11.414876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=17 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:11.498639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=17 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:35.154407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a7805-d08d-4a20-8989-ae143eab8e38 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:35.154407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a7805-d08d-4a20-8989-ae143eab8e38 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:35.154407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a7805-d08d-4a20-8989-ae143eab8e38 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.154407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 737/1471] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:35.161012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df00e-a3b1-4fd3-bd80-548c4d6f8f3e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:35.161539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df00e-a3b1-4fd3-bd80-548c4d6f8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:35.161649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df00e-a3b1-4fd3-bd80-548c4d6f8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.181753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7b4df00e-a3b1-4fd3-bd80-548c4d6f8f3e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:35.182982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b4df00e-a3b1-4fd3-bd80-548c4d6f8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:35.191317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 735/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:35.242211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd356fb-c924-44df-b23b-cb7502efad8c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:35.242499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd356fb-c924-44df-b23b-cb7502efad8c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:35.243374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd356fb-c924-44df-b23b-cb7502efad8c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.244855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 738/1473] 10.222.0.67 () {54 vars in 962 bytes} [Fri May 27 09:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:35.250044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51918ceb-eeca-46ac-9b76-f0654c61326d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:35.250367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51918ceb-eeca-46ac-9b76-f0654c61326d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:35.250634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51918ceb-eeca-46ac-9b76-f0654c61326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.270210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-51918ceb-eeca-46ac-9b76-f0654c61326d None None] MFA Rules not processed for user `7a4af657aef94d1abff7bc9c10264832`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:35.271489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-51918ceb-eeca-46ac-9b76-f0654c61326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:35.278641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 736/1474] 10.222.0.67 () {58 vars in 1059 bytes} [Fri May 27 09:30:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:35.286372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd356fb-c924-44df-b23b-cb7502efad8c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:35.298159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd356fb-c924-44df-b23b-cb7502efad8c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:35.302405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9f7e-907a-4ea4-8c46-528b79d52e2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:35.303047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9f7e-907a-4ea4-8c46-528b79d52e2a service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:35.303328 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9f7e-907a-4ea4-8c46-528b79d52e2a service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:35.303605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9f7e-907a-4ea4-8c46-528b79d52e2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.317953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9f7e-907a-4ea4-8c46-528b79d52e2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:35.319931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9f7e-907a-4ea4-8c46-528b79d52e2a service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:35.330740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 739/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:30:37.720633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a89e-8ae8-4acc-b8d4-be01890e1d35 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:37.721235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a89e-8ae8-4acc-b8d4-be01890e1d35 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:37.721235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a89e-8ae8-4acc-b8d4-be01890e1d35 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:37.723975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 737/1476] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:37.736435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a990f0-8396-4aac-93df-05f91ee10484 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:37.737008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a990f0-8396-4aac-93df-05f91ee10484 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:37.737008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a990f0-8396-4aac-93df-05f91ee10484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:37.881509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-85a990f0-8396-4aac-93df-05f91ee10484 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:37.882725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-85a990f0-8396-4aac-93df-05f91ee10484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:37.890850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 740/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:30:37.915883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a89e-8ae8-4acc-b8d4-be01890e1d35 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:37.928447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a89e-8ae8-4acc-b8d4-be01890e1d35 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:37.933451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:37.934103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:37.934382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:37.934656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:37.935381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:37.937196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:30:37.937196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:30:37.937196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:30:37.938354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fd69-0192-4e5c-8ee1-81edf8351cbe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:37.964223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 738/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Fri May 27 09:30:37 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:30:40.231304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0522-e367-48b8-9095-bd84bc8be4dd None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:40.231972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0522-e367-48b8-9095-bd84bc8be4dd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:40.231972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0522-e367-48b8-9095-bd84bc8be4dd None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:40.233529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 741/1479] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:40.238949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe382a-af7c-4862-bff2-e784be92a4a8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:40.239350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe382a-af7c-4862-bff2-e784be92a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:40.239513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe382a-af7c-4862-bff2-e784be92a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:40.257747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bebe382a-af7c-4862-bff2-e784be92a4a8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:40.259521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bebe382a-af7c-4862-bff2-e784be92a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:40.267311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 739/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:40.311640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0522-e367-48b8-9095-bd84bc8be4dd None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:40.326303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0522-e367-48b8-9095-bd84bc8be4dd None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:40.331649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578fec0-618a-4cb3-ae97-f5bac5b5ec79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:40.332312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578fec0-618a-4cb3-ae97-f5bac5b5ec79 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:40.332684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578fec0-618a-4cb3-ae97-f5bac5b5ec79 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:40.332953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578fec0-618a-4cb3-ae97-f5bac5b5ec79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:40.341230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578fec0-618a-4cb3-ae97-f5bac5b5ec79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:40.342799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578fec0-618a-4cb3-ae97-f5bac5b5ec79 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:40.352107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 742/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:42.777133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75284f-3812-4100-96e5-6049dcdb9c86 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:42.777707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75284f-3812-4100-96e5-6049dcdb9c86 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:42.777707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75284f-3812-4100-96e5-6049dcdb9c86 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:42.779169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 740/1482] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:42.785152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942e64-eabf-40d7-a88c-a5c80ec9b129 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:42.785719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942e64-eabf-40d7-a88c-a5c80ec9b129 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:42.785719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942e64-eabf-40d7-a88c-a5c80ec9b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:42.803700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e0942e64-eabf-40d7-a88c-a5c80ec9b129 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:42.805560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0942e64-eabf-40d7-a88c-a5c80ec9b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:42.813428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 743/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:42.849308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75284f-3812-4100-96e5-6049dcdb9c86 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:42.860633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75284f-3812-4100-96e5-6049dcdb9c86 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:42.864141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b1a35-6475-456f-a3d6-5ccfacd97093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:42.864814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b1a35-6475-456f-a3d6-5ccfacd97093 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:42.865099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b1a35-6475-456f-a3d6-5ccfacd97093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:42.865376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b1a35-6475-456f-a3d6-5ccfacd97093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:42.874887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b1a35-6475-456f-a3d6-5ccfacd97093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:42.876703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b1a35-6475-456f-a3d6-5ccfacd97093 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:42.885950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 741/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:45.154018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ff0f3-2b97-4204-a790-e66fa8a70402 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:45.154565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ff0f3-2b97-4204-a790-e66fa8a70402 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:45.154565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ff0f3-2b97-4204-a790-e66fa8a70402 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:45.155864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 744/1485] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:45.162732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fd4fc-124c-42cd-b4ee-a2b1afe9dd16 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:45.163324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fd4fc-124c-42cd-b4ee-a2b1afe9dd16 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:45.163324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fd4fc-124c-42cd-b4ee-a2b1afe9dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:45.181333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-430fd4fc-124c-42cd-b4ee-a2b1afe9dd16 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:45.182500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-430fd4fc-124c-42cd-b4ee-a2b1afe9dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:45.190507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 742/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:30:45.229709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ff0f3-2b97-4204-a790-e66fa8a70402 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:45.240822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ff0f3-2b97-4204-a790-e66fa8a70402 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:45.245231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed0a74-0abd-41b4-87bc-3680526d78cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:45.245883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed0a74-0abd-41b4-87bc-3680526d78cb service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:45.246165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed0a74-0abd-41b4-87bc-3680526d78cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:45.246442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed0a74-0abd-41b4-87bc-3680526d78cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:45.256872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed0a74-0abd-41b4-87bc-3680526d78cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:45.258822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed0a74-0abd-41b4-87bc-3680526d78cb service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:45.269505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 745/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:47.686709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9d6fe-e2eb-4e30-8169-6853d5be44ef None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.687328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9d6fe-e2eb-4e30-8169-6853d5be44ef None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.687763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9d6fe-e2eb-4e30-8169-6853d5be44ef None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.690473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 743/1488] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:47.696700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe6c2-50cd-4404-a37c-e117d8389214 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.697270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe6c2-50cd-4404-a37c-e117d8389214 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.697270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe6c2-50cd-4404-a37c-e117d8389214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.717019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4b1fe6c2-50cd-4404-a37c-e117d8389214 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:47.718259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4b1fe6c2-50cd-4404-a37c-e117d8389214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:47.727219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 746/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:47.767230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9d6fe-e2eb-4e30-8169-6853d5be44ef None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:47.780364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9d6fe-e2eb-4e30-8169-6853d5be44ef None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:47.784534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495344b-a81c-4a76-b331-572b5f939c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:47.785194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495344b-a81c-4a76-b331-572b5f939c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.785499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495344b-a81c-4a76-b331-572b5f939c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.785806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495344b-a81c-4a76-b331-572b5f939c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.796897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495344b-a81c-4a76-b331-572b5f939c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:47.805198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495344b-a81c-4a76-b331-572b5f939c7d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:47.809662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 744/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:50.512787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865e59-7894-48ce-9875-4bf5f36a75db None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:50.513366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865e59-7894-48ce-9875-4bf5f36a75db None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:50.513366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865e59-7894-48ce-9875-4bf5f36a75db None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:50.514719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 747/1491] 10.222.0.67 () {54 vars in 926 bytes} [Fri May 27 09:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:50.520235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535ecf-826a-4c1a-bc1d-c977ea2f2580 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:50.520722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535ecf-826a-4c1a-bc1d-c977ea2f2580 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:50.520843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535ecf-826a-4c1a-bc1d-c977ea2f2580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:50.545417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fe535ecf-826a-4c1a-bc1d-c977ea2f2580 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:50.546597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fe535ecf-826a-4c1a-bc1d-c977ea2f2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:50.554865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 745/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Fri May 27 09:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:50.593334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865e59-7894-48ce-9875-4bf5f36a75db None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:50.604660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865e59-7894-48ce-9875-4bf5f36a75db None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:50.608162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca956f4a-9fc9-4c8e-8726-5ccb60cd758f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:50.608854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956f4a-9fc9-4c8e-8726-5ccb60cd758f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:50.609140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956f4a-9fc9-4c8e-8726-5ccb60cd758f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:50.609417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956f4a-9fc9-4c8e-8726-5ccb60cd758f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:50.618296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca956f4a-9fc9-4c8e-8726-5ccb60cd758f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:50.619741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca956f4a-9fc9-4c8e-8726-5ccb60cd758f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:50.629670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 748/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:00.540117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=33 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:00.627464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=33 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:42.710367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.711042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.711042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.729328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:42.730544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:42.739180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 746/1494] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:42.748626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.749150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.749254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.767169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:42.768425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:42.776469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 749/1495] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:42.781004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.791206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf846006-3fbc-4556-aa1b-0a6c4de60ffb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:42.795896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:42.800590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.800590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.800590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.800590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:32:42.800590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:42.801106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:42.801106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:32:42.801106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:32:42.801106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:42.813170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 747/1496] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:32:42.821456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.830693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae67813-1166-4dbb-b179-1f7250101481 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:42.835520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:42.836201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:32:42.842350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:42.935788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 750/1497] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:32:42.940173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.950589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473727ef-09ff-4fa9-bbd7-a7790de6ceb0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.008283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.009257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.009546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.009850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.010553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.011579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:43.011579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:32:43.011579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:32:43.013093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.088705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 748/1498] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:32:43.092928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:43.103834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bfdab-1b52-4234-927d-eba1d6417eb6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.108555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.109554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.109834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.110108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.110834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.111861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:43.111861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:32:43.111861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:32:43.112772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.126434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 751/1499] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:32:43.130621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:43.141845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa45b-ffd2-45ef-955c-6d7185911997 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.147053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.147718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.148001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.148278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.149142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.150213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:43.150213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:32:43.150213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:32:43.151105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7cf7-5efa-4afb-ba5f-451404b6a548 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.165469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 749/1500] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:32:43.170154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:43.180694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03783-35a0-4dc0-ada2-5fc0d9c2f55a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.185285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.187468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.187468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.187468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] PATH_INFO: `/v3/projects/d09f1c0ae2994228a6bdaf6a65d40817/users/bc275dc69d9b48aebbe3d7a22ab9792a/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.202800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09f1c0ae2994228a6bdaf6a65d40817, user_id=bc275dc69d9b48aebbe3d7a22ab9792a, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.204018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:43.204018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:32:43.204018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:32:43.206000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecce5cd-e136-4d60-988e-97e9adcaa91c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.298147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 752/1501] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:32:43 2022] PUT /identity/v3/projects/d09f1c0ae2994228a6bdaf6a65d40817/users/bc275dc69d9b48aebbe3d7a22ab9792a/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:32:43.309788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614433-9741-48c8-ae88-ee3d6b2d2327 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.310242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614433-9741-48c8-ae88-ee3d6b2d2327 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.310404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614433-9741-48c8-ae88-ee3d6b2d2327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.337973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-db614433-9741-48c8-ae88-ee3d6b2d2327 None None] MFA Rules not processed for user `bc275dc69d9b48aebbe3d7a22ab9792a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:43.339250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-db614433-9741-48c8-ae88-ee3d6b2d2327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:43.407456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 750/1502] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:32:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:43.422101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0775995-5a54-4cc5-9ae0-dfc64aec6f5c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.422101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0775995-5a54-4cc5-9ae0-dfc64aec6f5c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.422101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0775995-5a54-4cc5-9ae0-dfc64aec6f5c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.436178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 753/1503] 10.222.0.67 () {54 vars in 963 bytes} [Fri May 27 09:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:43.436280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c0a39-802b-47e8-a9cf-83a572cf2cee None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.436280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c0a39-802b-47e8-a9cf-83a572cf2cee None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.436280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c0a39-802b-47e8-a9cf-83a572cf2cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.449250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-127c0a39-802b-47e8-a9cf-83a572cf2cee None None] MFA Rules not processed for user `bb1b0792dd6a41ba82c5d04a08596bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:43.450721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-127c0a39-802b-47e8-a9cf-83a572cf2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:43.497452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:43.505419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 751/1504] 10.222.0.67 () {58 vars in 1060 bytes} [Fri May 27 09:32:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:43.513432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0775995-5a54-4cc5-9ae0-dfc64aec6f5c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:43.526838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0775995-5a54-4cc5-9ae0-dfc64aec6f5c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.530566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.531208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.532210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.539551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.541390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.542837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.553718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 754/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:32:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:43.596389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabade03-f5b4-4ec9-92b4-fb21cd08a07b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.596681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabade03-f5b4-4ec9-92b4-fb21cd08a07b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.596959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabade03-f5b4-4ec9-92b4-fb21cd08a07b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.598249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 752/1506] 10.222.0.67 () {52 vars in 829 bytes} [Fri May 27 09:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:43.601922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:43.666616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077d7b-c6de-4384-aa48-fcea282bbda7 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.671183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.672059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.672367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.672647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] PATH_INFO: `/v3/users/bc275dc69d9b48aebbe3d7a22ab9792a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.673887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc275dc69d9b48aebbe3d7a22ab9792a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.674915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:43.674915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:32:43.674915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:32:43.676122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.935898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc275dc69d9b48aebbe3d7a22ab9792a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.031891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc275dc69d9b48aebbe3d7a22ab9792a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.032723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc275dc69d9b48aebbe3d7a22ab9792a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.033349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc275dc69d9b48aebbe3d7a22ab9792a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.054585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc275dc69d9b48aebbe3d7a22ab9792a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.063372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:44.073308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 755/1507] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:32:43 2022] DELETE /identity/v3/users/bc275dc69d9b48aebbe3d7a22ab9792a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:32:44.077964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:44.081493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:44.081493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:44.097723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:44.098933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:44.159464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 753/1508] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:44.170180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:44.171626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:44.233924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02b0b-7849-4121-acbd-fe18f7b286ae admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:44.238258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7734f82-fd58-422e-aecf-0b7de55e9b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:44.238930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734f82-fd58-422e-aecf-0b7de55e9b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:44.239209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734f82-fd58-422e-aecf-0b7de55e9b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:44.239482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734f82-fd58-422e-aecf-0b7de55e9b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:44.248951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734f82-fd58-422e-aecf-0b7de55e9b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:44.250459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734f82-fd58-422e-aecf-0b7de55e9b2e service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:44.260062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 756/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:44.723786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:44.725281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:44.737112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d2f8-0ebd-446e-9086-fae53a971779 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:44.741946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:44.743632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:44.743923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:44.744569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] PATH_INFO: `/v3/projects/d09f1c0ae2994228a6bdaf6a65d40817` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:44.745767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09f1c0ae2994228a6bdaf6a65d40817)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:44.746790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:44.746790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:32:44.746790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:32:44.748692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:44.879913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09f1c0ae2994228a6bdaf6a65d40817', 'request_id': 'req-b3608790-a5c1-4cba-b6f8-f050816b43bb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.886003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09f1c0ae2994228a6bdaf6a65d40817', 'request_id': 'req-b3608790-a5c1-4cba-b6f8-f050816b43bb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.900081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09f1c0ae2994228a6bdaf6a65d40817', 'request_id': 'req-b3608790-a5c1-4cba-b6f8-f050816b43bb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.991800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] The token cache is being invalidate because project d09f1c0ae2994228a6bdaf6a65d40817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:32:44.992011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.992760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b3608790-a5c1-4cba-b6f8-f050816b43bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:44.994473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 754/1510] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:32:44 2022] DELETE /identity/v3/projects/d09f1c0ae2994228a6bdaf6a65d40817 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:32:54.255813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=29 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:54.988222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:34.927348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96f1f-585e-4119-b438-1d695876fd37 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:34.927944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96f1f-585e-4119-b438-1d695876fd37 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:34.927944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96f1f-585e-4119-b438-1d695876fd37 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:34.929354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:34.934498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c29e26-e660-4753-9961-cdf95a0ab835 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:34.937744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c29e26-e660-4753-9961-cdf95a0ab835 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:34.937744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c29e26-e660-4753-9961-cdf95a0ab835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:34.954160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-39c29e26-e660-4753-9961-cdf95a0ab835 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:34.955367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39c29e26-e660-4753-9961-cdf95a0ab835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:35.012849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:35.182868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96f1f-585e-4119-b438-1d695876fd37 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:35.184628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-75b96f1f-585e-4119-b438-1d695876fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:35.261379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96f1f-585e-4119-b438-1d695876fd37 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:35.267544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe94d5d-8c1c-4eaf-b4ac-45f89c438a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:35.268207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe94d5d-8c1c-4eaf-b4ac-45f89c438a9f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:35.268521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe94d5d-8c1c-4eaf-b4ac-45f89c438a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:35.268806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe94d5d-8c1c-4eaf-b4ac-45f89c438a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:35.277612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe94d5d-8c1c-4eaf-b4ac-45f89c438a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:35.279207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe94d5d-8c1c-4eaf-b4ac-45f89c438a9f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:35.289852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 758/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:36.186306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a30f8-0e9f-4087-8956-cb37488128ca None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:36.186878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a30f8-0e9f-4087-8956-cb37488128ca None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:36.186878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a30f8-0e9f-4087-8956-cb37488128ca None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:36.188238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:36.193346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab7ac2-ceba-4d97-a9a4-21e29a30118a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:36.193766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab7ac2-ceba-4d97-a9a4-21e29a30118a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:36.193954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab7ac2-ceba-4d97-a9a4-21e29a30118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:36.212286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f7ab7ac2-ceba-4d97-a9a4-21e29a30118a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:36.213562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f7ab7ac2-ceba-4d97-a9a4-21e29a30118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:36.222025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:36.376955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a30f8-0e9f-4087-8956-cb37488128ca None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:36.392649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a30f8-0e9f-4087-8956-cb37488128ca None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:36.398138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603b9ec-94c2-4d0e-b086-9be8b4a1ec2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:36.398798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b9ec-94c2-4d0e-b086-9be8b4a1ec2b service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:36.399097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b9ec-94c2-4d0e-b086-9be8b4a1ec2b service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:36.399367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b9ec-94c2-4d0e-b086-9be8b4a1ec2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:36.408276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603b9ec-94c2-4d0e-b086-9be8b4a1ec2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:36.412157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603b9ec-94c2-4d0e-b086-9be8b4a1ec2b service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:36.419343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 757/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:36.441921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf76bd5-57fa-4a4c-b475-e4edcc951aa0 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:36.442306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf76bd5-57fa-4a4c-b475-e4edcc951aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:36.442660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf76bd5-57fa-4a4c-b475-e4edcc951aa0 None None] PATH_INFO: `/v3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:36.443970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 760/1517] 10.222.0.40 () {54 vars in 925 bytes} [Fri May 27 09:34:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:34:36.450016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96beeeb-d809-43f8-8d35-e99a2bc1533c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:36.450396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96beeeb-d809-43f8-8d35-e99a2bc1533c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:36.450604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96beeeb-d809-43f8-8d35-e99a2bc1533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:36.471731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a96beeeb-d809-43f8-8d35-e99a2bc1533c None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:36.475348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a96beeeb-d809-43f8-8d35-e99a2bc1533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:36.544452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 758/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Fri May 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:40.688068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da134-cecc-452f-a2cc-ab18d2cdda6c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:40.688686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da134-cecc-452f-a2cc-ab18d2cdda6c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:40.688686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da134-cecc-452f-a2cc-ab18d2cdda6c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:40.690007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 761/1519] 10.222.0.67 () {54 vars in 960 bytes} [Fri May 27 09:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:40.695129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f7a49-8a1b-435c-b9f3-bf0452f5913d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:40.695572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f7a49-8a1b-435c-b9f3-bf0452f5913d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:40.695668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f7a49-8a1b-435c-b9f3-bf0452f5913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:40.714432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-225f7a49-8a1b-435c-b9f3-bf0452f5913d None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:40.715629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-225f7a49-8a1b-435c-b9f3-bf0452f5913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:40.724576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 759/1520] 10.222.0.67 () {58 vars in 1057 bytes} [Fri May 27 09:34:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:40.732029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da134-cecc-452f-a2cc-ab18d2cdda6c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:40.746785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da134-cecc-452f-a2cc-ab18d2cdda6c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:40.752349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099dfff-5cb2-4402-be5a-5915ec373cae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:40.752989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099dfff-5cb2-4402-be5a-5915ec373cae service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:40.753277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099dfff-5cb2-4402-be5a-5915ec373cae service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:40.753531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099dfff-5cb2-4402-be5a-5915ec373cae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:40.762134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099dfff-5cb2-4402-be5a-5915ec373cae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:40.764638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099dfff-5cb2-4402-be5a-5915ec373cae service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:40.774520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 762/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:47.708842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e3b2d-3b0d-41ce-85be-744c384312ac None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:47.709411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e3b2d-3b0d-41ce-85be-744c384312ac None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:47.709411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e3b2d-3b0d-41ce-85be-744c384312ac None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:47.710793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:47.715670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b395a-434c-4711-9bf5-a54dab0bf048 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:47.716636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b395a-434c-4711-9bf5-a54dab0bf048 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:47.716793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b395a-434c-4711-9bf5-a54dab0bf048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:47.735058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f62b395a-434c-4711-9bf5-a54dab0bf048 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:47.736272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f62b395a-434c-4711-9bf5-a54dab0bf048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:47.744175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:47.901042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e3b2d-3b0d-41ce-85be-744c384312ac None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:47.916087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e3b2d-3b0d-41ce-85be-744c384312ac None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:47.921765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dff6d0-e1b7-4364-8775-d5d3fd218948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:47.924736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dff6d0-e1b7-4364-8775-d5d3fd218948 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:47.924736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dff6d0-e1b7-4364-8775-d5d3fd218948 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:47.924736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dff6d0-e1b7-4364-8775-d5d3fd218948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:47.932085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dff6d0-e1b7-4364-8775-d5d3fd218948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:47.933729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dff6d0-e1b7-4364-8775-d5d3fd218948 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:47.943735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 761/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:48.817685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bf7e5-f32c-46a1-89f4-c7a04080374d None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:48.818263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bf7e5-f32c-46a1-89f4-c7a04080374d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:48.818263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bf7e5-f32c-46a1-89f4-c7a04080374d None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:48.819620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:48.824776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97419-f8be-4658-8f15-cc5ea91c2ea7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:48.825280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97419-f8be-4658-8f15-cc5ea91c2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:48.825899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97419-f8be-4658-8f15-cc5ea91c2ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:48.844810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c7b97419-f8be-4658-8f15-cc5ea91c2ea7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:48.846034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c7b97419-f8be-4658-8f15-cc5ea91c2ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:48.853974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:49.007476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bf7e5-f32c-46a1-89f4-c7a04080374d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:49.022308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bf7e5-f32c-46a1-89f4-c7a04080374d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:49.027701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eab36-eec4-486f-aec5-d8870de283d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:49.028348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eab36-eec4-486f-aec5-d8870de283d8 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:49.028641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eab36-eec4-486f-aec5-d8870de283d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:49.028919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eab36-eec4-486f-aec5-d8870de283d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:49.037076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0eab36-eec4-486f-aec5-d8870de283d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:49.038669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0eab36-eec4-486f-aec5-d8870de283d8 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:49.047979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 765/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:53.491223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d508c66-fcd7-4cf2-960f-0e8a69c1b9a5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:53.491734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d508c66-fcd7-4cf2-960f-0e8a69c1b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:53.491734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d508c66-fcd7-4cf2-960f-0e8a69c1b9a5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:53.493109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:34:53.499011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b71ec-c1fc-4acd-9602-7c2a6ae4a052 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:53.499456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b71ec-c1fc-4acd-9602-7c2a6ae4a052 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:53.499601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b71ec-c1fc-4acd-9602-7c2a6ae4a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:53.517714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c05b71ec-c1fc-4acd-9602-7c2a6ae4a052 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:53.518922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c05b71ec-c1fc-4acd-9602-7c2a6ae4a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:53.526882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:34:53.563441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d508c66-fcd7-4cf2-960f-0e8a69c1b9a5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:53.565155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8d508c66-fcd7-4cf2-960f-0e8a69c1b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:53.622631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d508c66-fcd7-4cf2-960f-0e8a69c1b9a5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:53.626287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be8768-4aab-4697-a091-58a394aaafd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:53.626946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8768-4aab-4697-a091-58a394aaafd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:53.627230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8768-4aab-4697-a091-58a394aaafd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:53.627512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8768-4aab-4697-a091-58a394aaafd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:53.638171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be8768-4aab-4697-a091-58a394aaafd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:53.644829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be8768-4aab-4697-a091-58a394aaafd4 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:53.644829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:53.649654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 764/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:55.849985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff78b-4175-49ba-bb7e-4c8fb1ea9297 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:55.850524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff78b-4175-49ba-bb7e-4c8fb1ea9297 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:55.850524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff78b-4175-49ba-bb7e-4c8fb1ea9297 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:55.851929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:55.857719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ebf1-a0a2-467b-b980-de5afe11c5b7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:55.858215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ebf1-a0a2-467b-b980-de5afe11c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:55.858357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ebf1-a0a2-467b-b980-de5afe11c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:55.877493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b910ebf1-a0a2-467b-b980-de5afe11c5b7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:55.878692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b910ebf1-a0a2-467b-b980-de5afe11c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:55.886697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:55.922214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff78b-4175-49ba-bb7e-4c8fb1ea9297 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:55.932865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff78b-4175-49ba-bb7e-4c8fb1ea9297 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:55.937025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb1672-d955-4042-80c3-4748cb8d1e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:55.937655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb1672-d955-4042-80c3-4748cb8d1e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:55.937941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb1672-d955-4042-80c3-4748cb8d1e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:55.938219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb1672-d955-4042-80c3-4748cb8d1e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:55.947185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb1672-d955-4042-80c3-4748cb8d1e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:55.948810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb1672-d955-4042-80c3-4748cb8d1e08 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:55.958872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 768/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:59.898652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b14a4-34d8-4e1f-b936-24348ecfbf05 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:59.899251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b14a4-34d8-4e1f-b936-24348ecfbf05 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:59.899251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b14a4-34d8-4e1f-b936-24348ecfbf05 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:59.900694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:59.906107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac630f0-d238-4cea-ab5c-6ff1da1b9ac9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:59.906556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac630f0-d238-4cea-ab5c-6ff1da1b9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:59.906664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac630f0-d238-4cea-ab5c-6ff1da1b9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:59.924915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3ac630f0-d238-4cea-ab5c-6ff1da1b9ac9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:59.926114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3ac630f0-d238-4cea-ab5c-6ff1da1b9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:59.934555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:00.210705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b14a4-34d8-4e1f-b936-24348ecfbf05 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:00.212433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1d3b14a4-34d8-4e1f-b936-24348ecfbf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:00.270308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b14a4-34d8-4e1f-b936-24348ecfbf05 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:00.274133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf5d74-8d81-4d95-b792-555bbaae615e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:00.274782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf5d74-8d81-4d95-b792-555bbaae615e service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:00.275071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf5d74-8d81-4d95-b792-555bbaae615e service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:00.275351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf5d74-8d81-4d95-b792-555bbaae615e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:00.284854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf5d74-8d81-4d95-b792-555bbaae615e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:00.286281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf5d74-8d81-4d95-b792-555bbaae615e service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:00.295716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 767/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:02.514202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef29a8d-2ce8-46bc-929d-bf5aa221f038 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:02.514767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef29a8d-2ce8-46bc-929d-bf5aa221f038 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:02.514767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef29a8d-2ce8-46bc-929d-bf5aa221f038 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:02.516138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:35:02.521838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf198e12-1a8c-4e28-a0ec-58d17d45c096 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:02.522306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf198e12-1a8c-4e28-a0ec-58d17d45c096 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:02.522417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf198e12-1a8c-4e28-a0ec-58d17d45c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:02.540806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf198e12-1a8c-4e28-a0ec-58d17d45c096 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:02.542028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf198e12-1a8c-4e28-a0ec-58d17d45c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:02.550434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:02.822212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef29a8d-2ce8-46bc-929d-bf5aa221f038 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:02.823898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ef29a8d-2ce8-46bc-929d-bf5aa221f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:02.837029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef29a8d-2ce8-46bc-929d-bf5aa221f038 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:02.841155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030b4ea-71d0-4aa5-9d9d-dc259907fcd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:02.841792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030b4ea-71d0-4aa5-9d9d-dc259907fcd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:02.842077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030b4ea-71d0-4aa5-9d9d-dc259907fcd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:02.842360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030b4ea-71d0-4aa5-9d9d-dc259907fcd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:02.851768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030b4ea-71d0-4aa5-9d9d-dc259907fcd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:02.853234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030b4ea-71d0-4aa5-9d9d-dc259907fcd6 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:02.863468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 771/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:12.535511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=32 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:12.859373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=70 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:42.739102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.740364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.740693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.783633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:42.790159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:42.819136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 769/1540] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:42.832083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.832746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.833130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.898450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:42.900876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:42.925388 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 772/1541] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:42.932317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.959488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77549c5-c157-4012-af73-9e129d0ed667 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.975679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.976964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.977459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.977963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.979699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:42.980252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.983464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a278f0-1780-4b1b-812e-622036773759 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.019416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 770/1542] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:43.029531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.057911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d00c4a-1597-4b9b-9cbf-e765faa647c8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.076134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.077389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.077982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.078483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.084162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.089005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.098654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16790924-8ea0-45a5-8824-86e6d6c93efc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.099635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16790924-8ea0-45a5-8824-86e6d6c93efc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.100109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16790924-8ea0-45a5-8824-86e6d6c93efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.152085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-16790924-8ea0-45a5-8824-86e6d6c93efc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.153382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-16790924-8ea0-45a5-8824-86e6d6c93efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.169112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 771/1543] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:43.170511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa77c9-8ed9-4105-97fc-5cba609c2318 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.170800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa77c9-8ed9-4105-97fc-5cba609c2318 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.171082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa77c9-8ed9-4105-97fc-5cba609c2318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.205475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a7fa77c9-8ed9-4105-97fc-5cba609c2318 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.206784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7fa77c9-8ed9-4105-97fc-5cba609c2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.221245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 772/1544] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.222515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a40808-77ea-402f-a3db-aa4b613783d2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.222802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a40808-77ea-402f-a3db-aa4b613783d2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.223309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a40808-77ea-402f-a3db-aa4b613783d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.250868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-02a40808-77ea-402f-a3db-aa4b613783d2 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.252130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-02a40808-77ea-402f-a3db-aa4b613783d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.264609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 773/1545] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.265779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.266068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.266345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.303083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.303083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.308620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 773/1546] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/projects => generated 393 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:43.313403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 774/1547] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.323044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.323224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.329925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c699-a86d-41a3-8565-3b50cd238cb3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.404726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.405430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.405713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.405990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.406703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.408815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.558840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8622661-624c-4d67-a76d-42b9e23bdd29 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.564933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 775/1548] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:43.568389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.577563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.579389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.579683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.580169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.581497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:43.581827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.583125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:43.583125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:36:43.583125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:36:43.584068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012187-b446-464d-b4b9-20802a25d801 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.586229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188e49-d912-4f73-8c3e-2c1ca5837cf5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.597910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.600601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.602914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.603635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.605113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:43.608551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 774/1549] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:43.608717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.608809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.608809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.608809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.616159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848fe3b-26df-4249-82e8-e189310a7583 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.653506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 776/1550] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:43.655230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990b8a-7c98-4e73-a336-d65e971903c0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.655515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990b8a-7c98-4e73-a336-d65e971903c0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.655787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990b8a-7c98-4e73-a336-d65e971903c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.658290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.659573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.684034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 775/1551] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.685491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e6990b8a-7c98-4e73-a336-d65e971903c0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.685645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.687256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e6990b8a-7c98-4e73-a336-d65e971903c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.697750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 777/1552] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.704902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ec67e-1345-4f61-841d-155f593493cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.704902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ec67e-1345-4f61-841d-155f593493cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.704902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ec67e-1345-4f61-841d-155f593493cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.710611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec269a-cb5b-404d-afae-c5f7b1eba424 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.723088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.724945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.725883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.726399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.729208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.733809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.734916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-227ec67e-1345-4f61-841d-155f593493cb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.736280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-227ec67e-1345-4f61-841d-155f593493cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.746500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 778/1553] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.747163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ec67e-1345-4f61-841d-155f593493cb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.771713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 776/1554] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:43.773684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.776252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ec67e-1345-4f61-841d-155f593493cb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.792008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676b6d7-7a16-430c-857c-bac4be49eced admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.792276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.795385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.795908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.796426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.797770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.798107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135632d9-056c-4acc-b0aa-be4785c3c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.798856 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135632d9-056c-4acc-b0aa-be4785c3c364 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.799150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135632d9-056c-4acc-b0aa-be4785c3c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.799425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135632d9-056c-4acc-b0aa-be4785c3c364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.799712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:43.799712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:36:43.799712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:36:43.800195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135632d9-056c-4acc-b0aa-be4785c3c364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.802667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa6ceb-c16b-453a-a263-5b3d2fabe550 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.803401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135632d9-056c-4acc-b0aa-be4785c3c364 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.929972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 779/1555] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:43.931283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365a6e-bbb6-4421-9470-623709c8d2a2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.931580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365a6e-bbb6-4421-9470-623709c8d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.931867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365a6e-bbb6-4421-9470-623709c8d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.951879 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3a365a6e-bbb6-4421-9470-623709c8d2a2 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.955999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3a365a6e-bbb6-4421-9470-623709c8d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.987412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 777/1556] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/projects => generated 405 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:43.988979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.989314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.989650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.012248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:44.013777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:44.017899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:44.033336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 780/1557] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.035227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e2cb-c1cb-4b08-9385-f4c405c5815b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.035623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e2cb-c1cb-4b08-9385-f4c405c5815b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.036002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e2cb-c1cb-4b08-9385-f4c405c5815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.059729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a9e6e2cb-c1cb-4b08-9385-f4c405c5815b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:44.061536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a9e6e2cb-c1cb-4b08-9385-f4c405c5815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:44.090265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 778/1558] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.091168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.106213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457b202-edf6-4265-ad72-db9e0244ee72 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.111269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f93dd-043f-4a32-88de-d084b77d4ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.111960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f93dd-043f-4a32-88de-d084b77d4ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.112248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f93dd-043f-4a32-88de-d084b77d4ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.112566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f93dd-043f-4a32-88de-d084b77d4ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.113304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f93dd-043f-4a32-88de-d084b77d4ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.115005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f93dd-043f-4a32-88de-d084b77d4ed6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.127273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 779/1559] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:44.130784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.131282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.131755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.147964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 781/1560] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.149414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.149742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.150050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.155769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:44.157455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:44.167770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 780/1561] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.168722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.170293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:44.171824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:44.182279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84b285-3dec-4af5-83da-854cd88af2e5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.184232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 782/1562] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.185261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.187392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.188077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.188376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.188726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.189437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.190493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:44.190493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:36:44.190493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:36:44.191735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.201260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:44.201879 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99869f38-4d42-40b8-bdce-b022957c96c8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.208850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.209547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.209829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.210112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.217213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.217213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.308673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 781/1563] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:44.309806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.317916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 783/1564] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:44.317916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.322235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ebd3-f41c-4f2e-a892-bd0dd073c2db admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.326920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.327590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.327868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.328838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.328985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:44.329216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.331185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.336065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4a24d-a5a0-456f-91c2-22522411958e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.345964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.347297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.347787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.348279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.349961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:44.350614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.360748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 782/1565] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:44.360748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.361068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.373584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12a42-c661-4963-8339-94895589a56d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.391215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 784/1566] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:44.391215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.391749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.391749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.391749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.391749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] PATH_INFO: `/v3/projects/6a4290d24d1243679ce74b9d94a6b2f0/users/82bf01c0cdbc48fa9b78933314039ee1/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.392940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db078e-669c-4b49-9d99-30a3db61e980 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.400251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.401296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.401725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.402205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.403217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:44.403729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.406103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4290d24d1243679ce74b9d94a6b2f0, user_id=82bf01c0cdbc48fa9b78933314039ee1, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.406609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170488d-37d6-4087-a43e-ffe39b9bc6b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.411849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.425518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 785/1567] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:44.433100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad79a4-bdcd-4d20-be06-9a2bb5a35716 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.433100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad79a4-bdcd-4d20-be06-9a2bb5a35716 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.433100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad79a4-bdcd-4d20-be06-9a2bb5a35716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.451436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-45ad79a4-bdcd-4d20-be06-9a2bb5a35716 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:44.452891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-45ad79a4-bdcd-4d20-be06-9a2bb5a35716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:44.462811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 786/1568] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.467423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.467423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.467423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.484768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:44.486016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:44.495564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 787/1569] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:44.496474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.499035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 783/1570] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:44 2022] PUT /identity/v3/projects/6a4290d24d1243679ce74b9d94a6b2f0/users/82bf01c0cdbc48fa9b78933314039ee1/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:44.503375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.508502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281c76-c383-4eb2-8994-892736b22462 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.596785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.597830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.598327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.598839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.600241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.603388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.604399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752cbe7-539e-40f6-8a92-ec8d6e1fa9f7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.609949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.610748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.611030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.611313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.612119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.613841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.623991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 788/1571] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:44.625623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.626008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 784/1572] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:44.626877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.638278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61f64-a10d-4068-af74-70b6f4188fd8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.644937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.645170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6aaa-6f6b-45dc-b009-97aec20ebdc2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.646182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.646703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.647214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.648574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.650222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.650902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.651185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.651493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.652229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.652450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.654627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.807253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 789/1573] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:44.808673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.822384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:44.831605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 785/1574] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:44.831605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.905949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1980-5c34-4e20-8d9f-e600c4ef9968 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.913118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.913811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.914148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.914463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.915461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:44.915950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.918231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9f643-7e29-4296-9e4f-5d3107954117 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.918545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.925932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.927765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.928582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.929245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.930913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.934097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 786/1575] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:44.934959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.935187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.950381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40018-5a36-4bb0-84cf-31337a915eb8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.958295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.958295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.958295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.958295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.959051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:44.959051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.960555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a926d21-bdf8-4783-be1a-eb530b7a5bb1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.978910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 787/1576] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:44.992943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.992943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.992943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.009847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.011175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.019653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 788/1577] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:45.020693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.032886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:45.034008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6214b-ad76-4f57-93dc-799b56b3dbff None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.038925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.039743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.040061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.040398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.041135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.042788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.055707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 789/1578] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:45.056720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.072972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a792-8853-4604-8e54-dca2832a3527 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.075714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 790/1579] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/projects => generated 389 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:45.076711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.080967 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.082059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.082467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.083465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.084776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.088318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.102914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 790/1580] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:45.104840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.116840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845d9c-5397-492b-915c-b79b600b98c7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.194654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c737-baf4-42ca-b24b-e69f4656e805 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.198826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.200005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.200744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.200888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.201983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.204082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.206027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.207075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.207563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.208732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.209758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.213236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.327760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 791/1581] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:45.328747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.339890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac08808-e824-4fab-9132-52e1c93435b0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.345689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.346198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.346501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.346786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.347396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.349554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.385490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 791/1582] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/users => generated 287 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:45.386498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.398089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235435b7-9fff-4d36-a581-5092238fe469 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.403597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.404296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.404627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.404917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.405624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.407616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.464400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 792/1583] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:45.465620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.534812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 792/1584] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:45.534812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.548515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5faa-5bf6-44f6-9aa5-eae30ce2962e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.622231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.623637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.624184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.624791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.636633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.637114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2754-3a86-4e4a-af75-b060ee9ce420 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.638120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.643842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.646362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.646768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.647206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] PATH_INFO: `/v3/projects/64ba96b0f8b740adb843fb745b7716bd/users/6c073ecc855b44a18451e01049930497/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.650459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 793/1585] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:45.650658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:45.651754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.666565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76382-ea6e-40e4-b8c3-897d61fa2c23 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.672718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.673553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.673849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.674126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.674855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.677699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.683679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ba96b0f8b740adb843fb745b7716bd, user_id=6c073ecc855b44a18451e01049930497, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.684818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:45.684818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:36:45.684818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:36:45.685876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:45.686796 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.820269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 793/1586] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:45 2022] PUT /identity/v3/projects/64ba96b0f8b740adb843fb745b7716bd/users/6c073ecc855b44a18451e01049930497/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:45.821206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.834629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 794/1587] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:45.840724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.857153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c45b4-b24e-49d3-927f-e14e39f80992 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.919843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2dbbc-9b99-43a4-9b4e-6ed463687f2b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.926422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.927492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.927897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.928276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] PATH_INFO: `/v3/projects/96bfdc24989c45e8b2ef6398aff9bd55/users/3d7d647f678a4cdbb3b07b55c97dea27/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.947266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bfdc24989c45e8b2ef6398aff9bd55, user_id=3d7d647f678a4cdbb3b07b55c97dea27, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.949997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.954668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.954833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.954833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.954833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.954833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.954833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.967039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 795/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:45.968083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.979547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385e5b9-bcee-4606-b833-d5c22f642b32 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.985299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.987668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.987668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.987668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.988531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.991405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.005805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 796/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.007877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.022671 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9d444-f03f-4cc1-8b3d-e2d3378e6c4e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.028826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb4920-d2aa-44f6-bcf1-3e45cf712090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.029527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb4920-d2aa-44f6-bcf1-3e45cf712090 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.029834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb4920-d2aa-44f6-bcf1-3e45cf712090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.030101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb4920-d2aa-44f6-bcf1-3e45cf712090 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.030861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb4920-d2aa-44f6-bcf1-3e45cf712090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.033222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb4920-d2aa-44f6-bcf1-3e45cf712090 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.081823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 794/1590] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:45 2022] PUT /identity/v3/projects/96bfdc24989c45e8b2ef6398aff9bd55/users/3d7d647f678a4cdbb3b07b55c97dea27/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:46.084012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.171477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 797/1591] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:46.173081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.173408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.173702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.194918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:46.196585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.202701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df33c4-88fd-4fb4-80fb-a5bf27b75243 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.205826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 798/1592] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:46.206686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.208664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.209890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.210438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.211024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.212461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.216583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.219386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e127b-ae4c-49a0-b249-23c30447fec3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.225002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.225690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.225978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.226260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.227010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.229009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.241398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 799/1593] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.243327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.257372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03360-da23-4da4-a144-b6d3e43ea24a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.263987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.265066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.265471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.265810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.266700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.268489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.285890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 800/1594] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.285890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.296848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5f9f9-fd94-4c48-9218-438c0d86cf6b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.305697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dcb36-cdf1-44a6-af68-9db5a391c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.306400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dcb36-cdf1-44a6-af68-9db5a391c61e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.306689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dcb36-cdf1-44a6-af68-9db5a391c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.307102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dcb36-cdf1-44a6-af68-9db5a391c61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.307861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dcb36-cdf1-44a6-af68-9db5a391c61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.309681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dcb36-cdf1-44a6-af68-9db5a391c61e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.321995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 801/1595] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.326546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.326546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.326546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.346588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 795/1596] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:46.348952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.368800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511df19-cbd5-4d9c-bb3e-84f38edd4f77 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.377325 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] MFA Rules not processed for user `3d7d647f678a4cdbb3b07b55c97dea27`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:46.378705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.398433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.399948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.400622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.401198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.402729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.410193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.432436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 796/1597] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.433870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.477818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 802/1598] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:46.478751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.493181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed73ea-be49-426f-8850-de5179e17279 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.500184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.500902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.501201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.501497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.502399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.504253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.507600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.521579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 803/1599] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.523304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.541853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.542301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3508a2-c5be-47a8-89bd-dda314842a3f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.551168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.553199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.554075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.554691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] PATH_INFO: `/v3/projects/adc4f78ff2f141c3b1bd4a1a10a85e38/users/415775dc8e6a484d8894bdeaab4da631/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.556941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bb271-7768-4c56-83de-67c2baefba9c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.563175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.564670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.564810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.565480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.576618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc4f78ff2f141c3b1bd4a1a10a85e38, user_id=415775dc8e6a484d8894bdeaab4da631, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.579942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.584566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.587504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.606850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 797/1600] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:46.608430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.626818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc5af0-8ec3-4a79-8fa9-d2869ba31454 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.636373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.638197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.638553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.638890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] PATH_INFO: `/v3/projects/ad2dc5a66f084d68bc9f6e8751306cec/users/39aea954d7094100b9dd53ba0283cee6/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.660917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2dc5a66f084d68bc9f6e8751306cec, user_id=39aea954d7094100b9dd53ba0283cee6, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.664310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.690586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 804/1601] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:46 2022] PUT /identity/v3/projects/adc4f78ff2f141c3b1bd4a1a10a85e38/users/415775dc8e6a484d8894bdeaab4da631/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:46.693537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.795764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 798/1602] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:46 2022] PUT /identity/v3/projects/ad2dc5a66f084d68bc9f6e8751306cec/users/39aea954d7094100b9dd53ba0283cee6/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:46.798010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.809694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c3d5-1e70-4581-94b0-c8ccefd26706 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.915934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aff5e-9ebe-409d-9fc7-a90451028856 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.919867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b653b-6c73-480a-a74a-7f410c33c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.920660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b653b-6c73-480a-a74a-7f410c33c7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.921013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b653b-6c73-480a-a74a-7f410c33c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.921972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b653b-6c73-480a-a74a-7f410c33c7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.922753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b653b-6c73-480a-a74a-7f410c33c7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.923089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.923927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.924468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.924889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b653b-6c73-480a-a74a-7f410c33c7aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.925058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.925968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.928561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.949355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 805/1603] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.949633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 799/1604] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:46.949633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.949947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353055-5a5c-418d-945a-19abae6e159c None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.949947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353055-5a5c-418d-945a-19abae6e159c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.949947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353055-5a5c-418d-945a-19abae6e159c None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.949947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 806/1605] 10.222.0.67 () {54 vars in 961 bytes} [Fri May 27 09:36:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:46.949947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0caae-58ca-4cf5-869c-5309be94855d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.949947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0caae-58ca-4cf5-869c-5309be94855d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.950771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0caae-58ca-4cf5-869c-5309be94855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.956132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d658-4838-49c4-81f7-1fcba6b01b1b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.964828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.967003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.967599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.968188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] PATH_INFO: `/v3/projects/198c7fd541c549808b949d77fb74afc0/users/9e8aada8bb9642319ea99af1f98b9f70/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.972128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-71d0caae-58ca-4cf5-869c-5309be94855d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:46.973545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-71d0caae-58ca-4cf5-869c-5309be94855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.985240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 807/1606] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:46.985240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.985240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.985240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.007755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] RBAC: Authorizing `identity:create_grant(project_id=198c7fd541c549808b949d77fb74afc0, user_id=9e8aada8bb9642319ea99af1f98b9f70, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.019300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.047378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] MFA Rules not processed for user `39aea954d7094100b9dd53ba0283cee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:47.049913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.157263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 800/1607] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:46 2022] PUT /identity/v3/projects/198c7fd541c549808b949d77fb74afc0/users/9e8aada8bb9642319ea99af1f98b9f70/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:47.163531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.168478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 808/1608] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:47.168478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.187511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881caed8-244d-470b-9d67-c6aa663e5a41 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.237668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:47.253839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b0fbd-b5b2-4188-9c29-573f61d5449c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.262072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f788fb-c63f-4bf7-8053-d5c9f26cb159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.263180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f788fb-c63f-4bf7-8053-d5c9f26cb159 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.263657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f788fb-c63f-4bf7-8053-d5c9f26cb159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.264117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f788fb-c63f-4bf7-8053-d5c9f26cb159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.265511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f788fb-c63f-4bf7-8053-d5c9f26cb159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.269184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f788fb-c63f-4bf7-8053-d5c9f26cb159 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.286944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.289752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.290235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.290703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] PATH_INFO: `/v3/projects/b2391788ecae49f292810c2ba1118193/users/26155ca287a940d28c1505aa0be162ea/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.306018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 801/1609] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:47.310551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c125-e3fb-4b65-8d92-c6244d27ec7b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.317422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c125-e3fb-4b65-8d92-c6244d27ec7b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.318906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c125-e3fb-4b65-8d92-c6244d27ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.321887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2391788ecae49f292810c2ba1118193, user_id=26155ca287a940d28c1505aa0be162ea, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.341413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.352949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b5f8c125-e3fb-4b65-8d92-c6244d27ec7b None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:47.355004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b5f8c125-e3fb-4b65-8d92-c6244d27ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.416259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:47.460463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 809/1610] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:47 2022] PUT /identity/v3/projects/b2391788ecae49f292810c2ba1118193/users/26155ca287a940d28c1505aa0be162ea/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:47.466144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.499880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 802/1611] 10.222.0.67 () {58 vars in 1058 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:47.501495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.501835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.502125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.534713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:47.536075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.611568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a896-23b7-46f7-8a81-aef05c8d3f46 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.617408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 803/1612] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:47.618144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.619012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.620628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.621578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.622238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.629018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58d8ea-c147-4540-8626-6bb73bd23154 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.636072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80767c-0dc9-492e-b5a0-e72439a272fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.637042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80767c-0dc9-492e-b5a0-e72439a272fc admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.640430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80767c-0dc9-492e-b5a0-e72439a272fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.640430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80767c-0dc9-492e-b5a0-e72439a272fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.640430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80767c-0dc9-492e-b5a0-e72439a272fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.641404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80767c-0dc9-492e-b5a0-e72439a272fc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.647921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.651022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.677864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 810/1613] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:47.679804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.701395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43277f1-3cff-4a37-9701-84a5bb7c5189 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.710971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.712866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.713694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.714713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] PATH_INFO: `/v3/projects/b5b6ee5a88a54b44983b2a34f26ef871/users/e9da410dc3e642f3839f4d9915eb9904/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.749694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b6ee5a88a54b44983b2a34f26ef871, user_id=e9da410dc3e642f3839f4d9915eb9904, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.757884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.778624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 804/1614] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:47.780524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.782447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.782935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.816746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:47.819904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.856204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 811/1615] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:47 2022] PUT /identity/v3/projects/b5b6ee5a88a54b44983b2a34f26ef871/users/e9da410dc3e642f3839f4d9915eb9904/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:47.874559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.904560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 805/1616] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:47.905820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.002512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63c75-880c-4ec8-b165-8f8a48e47c54 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.007771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:48.018289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:48.032483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed6bc-87c1-48e0-85a7-6f740a54a424 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.037659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.038435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.038815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.039181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.084994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aae2c-14a1-407f-8296-e63700a188be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.087614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aae2c-14a1-407f-8296-e63700a188be service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.090017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aae2c-14a1-407f-8296-e63700a188be service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.091115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aae2c-14a1-407f-8296-e63700a188be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.131693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.133611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.146174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 812/1617] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:48.152956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.202074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aae2c-14a1-407f-8296-e63700a188be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.203767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aae2c-14a1-407f-8296-e63700a188be service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.218546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 806/1618] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:48.224918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.224918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.224918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.250445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7918-58ec-4dce-bb0b-ed4ae98d2439 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.256400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] MFA Rules not processed for user `e9da410dc3e642f3839f4d9915eb9904`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:48.257649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.264951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.264951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.264951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.264951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.265608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.266271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.348249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 813/1619] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:48.353693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.365135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.365768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 807/1620] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:48.366654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.380701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2574d5-edf5-44f7-9aa5-0f46b97307ab None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.386167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.387143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.387435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.387770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.388564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.390730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.405350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 808/1621] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:48.405800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7525c-4059-47ed-bfc6-3b56950a9710 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.406348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.419700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.420533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f06b-a081-4924-a6f9-fc69b67a4af5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.421091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.421624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.422349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.426520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.427798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.428149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.428534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.429565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.431933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.445715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.447240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.474513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 814/1622] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:48.475745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.487876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef319-f13b-457e-bad2-fb7673376c75 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.494379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.495647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.496163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.496829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] PATH_INFO: `/v3/projects/57ab244a9243496aa70ec2c266004f45/users/09786254e70541f0a8206bb3f900a318/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.525380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ab244a9243496aa70ec2c266004f45, user_id=09786254e70541f0a8206bb3f900a318, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.530956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.557570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 809/1623] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:48.564132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.649911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 815/1624] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:48 2022] PUT /identity/v3/projects/57ab244a9243496aa70ec2c266004f45/users/09786254e70541f0a8206bb3f900a318/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:48.672458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.762365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263f614-820d-45d8-adfa-5de4c4d19bf4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.872906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5b39-043e-480b-a3dd-6789849f0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.874748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5b39-043e-480b-a3dd-6789849f0de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.875470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5b39-043e-480b-a3dd-6789849f0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.875470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5b39-043e-480b-a3dd-6789849f0de5 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.876291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5b39-043e-480b-a3dd-6789849f0de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.878628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5b39-043e-480b-a3dd-6789849f0de5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.900403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c480da-2239-4abd-9869-dc6be5241eb6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.912924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:48.914896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bbed-bb0a-41cc-98dc-ece288a4508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.919927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bbed-bb0a-41cc-98dc-ece288a4508e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.919927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bbed-bb0a-41cc-98dc-ece288a4508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.919927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bbed-bb0a-41cc-98dc-ece288a4508e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.919927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bbed-bb0a-41cc-98dc-ece288a4508e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.923454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bbed-bb0a-41cc-98dc-ece288a4508e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.948845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 816/1625] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:36:48.951686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6873a0-849f-47b2-9e1d-606bab77fe7c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.953264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6873a0-849f-47b2-9e1d-606bab77fe7c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.953881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6873a0-849f-47b2-9e1d-606bab77fe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.976061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 810/1626] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:36:48.980730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655addc-384c-4c99-95ed-51ef4b2ee0e2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.980730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655addc-384c-4c99-95ed-51ef4b2ee0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.980730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655addc-384c-4c99-95ed-51ef4b2ee0e2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.980730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 811/1627] 10.222.0.67 () {54 vars in 912 bytes} [Fri May 27 09:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:48.981522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655addc-384c-4c99-95ed-51ef4b2ee0e2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.997751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655addc-384c-4c99-95ed-51ef4b2ee0e2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.012347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:49.024844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ba6873a0-849f-47b2-9e1d-606bab77fe7c None None] MFA Rules not processed for user `6c073ecc855b44a18451e01049930497`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:49.025267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.026179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.026490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.026763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] PATH_INFO: `/v3/projects/57ab244a9243496aa70ec2c266004f45/users/09786254e70541f0a8206bb3f900a318/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.027083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba6873a0-849f-47b2-9e1d-606bab77fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:49.037244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ab244a9243496aa70ec2c266004f45, user_id=09786254e70541f0a8206bb3f900a318, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.039495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.068408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 812/1628] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:48 2022] PUT /identity/v3/projects/57ab244a9243496aa70ec2c266004f45/users/09786254e70541f0a8206bb3f900a318/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:49.068408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.214336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 817/1629] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:49.217064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.217700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.218532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.257822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:49.263223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:49.266637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db716ea9-9074-482e-ae90-060164b92e15 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.273580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74e951-8844-4ac2-8ae5-1cf90106bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.274289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74e951-8844-4ac2-8ae5-1cf90106bea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.274606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74e951-8844-4ac2-8ae5-1cf90106bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.274951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74e951-8844-4ac2-8ae5-1cf90106bea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.275590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74e951-8844-4ac2-8ae5-1cf90106bea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.277457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74e951-8844-4ac2-8ae5-1cf90106bea9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.300069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 813/1630] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:49.300069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.300069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.300069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.363625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] MFA Rules not processed for user `09786254e70541f0a8206bb3f900a318`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:49.364518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 818/1631] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:49.365445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.367542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:49.385657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0175c0-2ee2-4c5d-852a-5d27ae81b385 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.392294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.393126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.393418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.393701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.394432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.397974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.481898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 814/1632] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:49.483100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.509141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f76f-ca52-47ee-af80-eb958d2cee7b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.529249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.530277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.530566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.530846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] PATH_INFO: `/v3/projects/827c8c4851b140ba8f4f9046db3e91c0/users/ac6bf625a0eb4c55a2aba14da8ce3ef1/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.563488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827c8c4851b140ba8f4f9046db3e91c0, user_id=ac6bf625a0eb4c55a2aba14da8ce3ef1, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.575396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.581917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 819/1633] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/projects => generated 403 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:49.583006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.665735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 815/1634] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:49 2022] PUT /identity/v3/projects/827c8c4851b140ba8f4f9046db3e91c0/users/ac6bf625a0eb4c55a2aba14da8ce3ef1/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:49.666623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.756769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0436247-1249-4b40-b4d7-83e3e4ce6051 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.801006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e913-e4d7-4cea-9065-d0faac55de44 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.813964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.814345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.814345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.814700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.168652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.168652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.168652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.168652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.173976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.173976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.173976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 816/1635] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:50.173976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.177853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.177853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.177853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 820/1636] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:50.177853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.180445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd776-686a-4032-8d5b-fd0f0d349948 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.180445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.180445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.180445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.181163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.181163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.181163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.182394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3b97-fbc7-4f5e-a195-5dd66a5dd688 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.182394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.182394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.182394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.183032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.183032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.183032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.186745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 821/1637] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:50.195915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.234021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1802c-ea2a-45e1-b625-c99a21d03fa2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.251096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f466-0858-46a3-8bc4-30c3ee805208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.253909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f466-0858-46a3-8bc4-30c3ee805208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.253909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f466-0858-46a3-8bc4-30c3ee805208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.254441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f466-0858-46a3-8bc4-30c3ee805208 admin admin] PATH_INFO: `/v3/projects/827c8c4851b140ba8f4f9046db3e91c0/users/ac6bf625a0eb4c55a2aba14da8ce3ef1/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.259666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6f466-0858-46a3-8bc4-30c3ee805208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827c8c4851b140ba8f4f9046db3e91c0, user_id=ac6bf625a0eb4c55a2aba14da8ce3ef1, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.266654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6f466-0858-46a3-8bc4-30c3ee805208 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.340537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 822/1638] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:50 2022] PUT /identity/v3/projects/827c8c4851b140ba8f4f9046db3e91c0/users/ac6bf625a0eb4c55a2aba14da8ce3ef1/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:50.344427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 817/1639] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/users => generated 308 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:50.344599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.344599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.344599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.345647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.379965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cce3f-2c67-4d82-a992-2b38377ab39e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.409532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] MFA Rules not processed for user `ac6bf625a0eb4c55a2aba14da8ce3ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:50.412513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.507895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:50.549211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:50.639699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 823/1640] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:50.700270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.703994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.704602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.705125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.706692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.727392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.737604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.754395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 818/1641] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:50.760824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.782038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238ec1a-6539-4b18-aadf-179f648c7520 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.815104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.822168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.825751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.826507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] PATH_INFO: `/v3/projects/d3c64b95f3e34f1cad1514679bf03692/users/99cb6b1fa268480bbf4a60f2464c878b/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.880900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c64b95f3e34f1cad1514679bf03692, user_id=99cb6b1fa268480bbf4a60f2464c878b, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.893533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.993648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 819/1642] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:50 2022] PUT /identity/v3/projects/d3c64b95f3e34f1cad1514679bf03692/users/99cb6b1fa268480bbf4a60f2464c878b/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:51.002278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.025372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c244b44-f8ca-45c9-b111-31c93e0b1346 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.234454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95205c-639b-4adc-b255-3b9a27e2212e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.236927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95205c-639b-4adc-b255-3b9a27e2212e service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.239655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95205c-639b-4adc-b255-3b9a27e2212e service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.240584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95205c-639b-4adc-b255-3b9a27e2212e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.262318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204e6c2-a62b-4c23-abaf-2fea08821006 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.275024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.276773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.277298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.277813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.279253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.282816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.327263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 820/1643] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:36:51.329151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.350184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fad879-40be-471e-803e-f7cb445c59a4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.362259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f40e-f9ba-4a90-820d-e020f647f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.364922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f40e-f9ba-4a90-820d-e020f647f7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.365983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f40e-f9ba-4a90-820d-e020f647f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.366585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f40e-f9ba-4a90-820d-e020f647f7c8 admin admin] PATH_INFO: `/v3/projects/d3c64b95f3e34f1cad1514679bf03692/users/99cb6b1fa268480bbf4a60f2464c878b/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.371434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f40e-f9ba-4a90-820d-e020f647f7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c64b95f3e34f1cad1514679bf03692, user_id=99cb6b1fa268480bbf4a60f2464c878b, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.374601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:51.377544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f40e-f9ba-4a90-820d-e020f647f7c8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.400471 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 821/1644] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:36:51 2022] PUT /identity/v3/projects/d3c64b95f3e34f1cad1514679bf03692/users/99cb6b1fa268480bbf4a60f2464c878b/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:51.419924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95205c-639b-4adc-b255-3b9a27e2212e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.423299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95205c-639b-4adc-b255-3b9a27e2212e service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.459085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 824/1645] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:51.479690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:52.663748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.675120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.675120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.862027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] MFA Rules not processed for user `26155ca287a940d28c1505aa0be162ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:52.868541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:52.932557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:53.229367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 822/1646] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:53.246700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e9a1-34d0-4c4b-a8ce-fa22643f2437 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.247918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e9a1-34d0-4c4b-a8ce-fa22643f2437 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.248395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e9a1-34d0-4c4b-a8ce-fa22643f2437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.269996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aba5e9a1-34d0-4c4b-a8ce-fa22643f2437 None None] MFA Rules not processed for user `26155ca287a940d28c1505aa0be162ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:53.272190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aba5e9a1-34d0-4c4b-a8ce-fa22643f2437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:53.280498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 825/1647] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:53.294147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.458887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a26c7-5016-42f5-a56c-b315f4e5cb08 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.467183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c5c3d-0379-4dbe-ab22-b3459e50a035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.467530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c5c3d-0379-4dbe-ab22-b3459e50a035 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.468741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c5c3d-0379-4dbe-ab22-b3459e50a035 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.469124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c5c3d-0379-4dbe-ab22-b3459e50a035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.481995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c5c3d-0379-4dbe-ab22-b3459e50a035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.484426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c5c3d-0379-4dbe-ab22-b3459e50a035 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.509992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 823/1648] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:53.779403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011e7ed-cea8-4c71-86dd-5cd2514a18f6 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.779817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011e7ed-cea8-4c71-86dd-5cd2514a18f6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.779955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011e7ed-cea8-4c71-86dd-5cd2514a18f6 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.782032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 826/1649] 10.222.0.67 () {54 vars in 961 bytes} [Fri May 27 09:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:53.791065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.791841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.791841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.825148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:53.825148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:53.850342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f63273-076a-4a4a-95c8-2ca073a87c0f None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.850631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f63273-076a-4a4a-95c8-2ca073a87c0f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.850910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f63273-076a-4a4a-95c8-2ca073a87c0f None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.854750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 827/1650] 10.222.0.67 () {54 vars in 912 bytes} [Fri May 27 09:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:36:53.861197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.862184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.862480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.865742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 824/1651] 10.222.0.67 () {58 vars in 1058 bytes} [Fri May 27 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:53.887108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:53.888660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:53.906699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 828/1652] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:53.911376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.933588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.938662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:54.087274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7139a-c587-406d-a15d-5b9d1e5f5b5a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:54.088470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3c32-14ef-48bb-8929-6164c11ffd58 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:54.096628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7373-d4d1-463c-b126-68dd1cc17a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:54.099734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7373-d4d1-463c-b126-68dd1cc17a7b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.100699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:54.101083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7373-d4d1-463c-b126-68dd1cc17a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.101476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7373-d4d1-463c-b126-68dd1cc17a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.103431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.104199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.106794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] PATH_INFO: `/v3/users/39aea954d7094100b9dd53ba0283cee6` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.110135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39aea954d7094100b9dd53ba0283cee6)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:54.112955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: WARNING py.warnings [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:54.112955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: warnings.warn(msg) May 27 09:36:54.112955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: May 27 09:36:54.117778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:54.135783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7373-d4d1-463c-b126-68dd1cc17a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:54.140270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7373-d4d1-463c-b126-68dd1cc17a7b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:54.174419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 829/1653] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:54.367476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:54.408397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39aea954d7094100b9dd53ba0283cee6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.509705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39aea954d7094100b9dd53ba0283cee6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.510351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39aea954d7094100b9dd53ba0283cee6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.572533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39aea954d7094100b9dd53ba0283cee6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.581088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa28cf99-9362-47d2-ac8a-4c861fe543c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39aea954d7094100b9dd53ba0283cee6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.646910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 825/1654] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:36:53 2022] DELETE /identity/v3/users/39aea954d7094100b9dd53ba0283cee6 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:54.647075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90668-2402-4a4b-a088-eefb83246472 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.647075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90668-2402-4a4b-a088-eefb83246472 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.647075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90668-2402-4a4b-a088-eefb83246472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.678538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eee90668-2402-4a4b-a088-eefb83246472 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:54.680191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eee90668-2402-4a4b-a088-eefb83246472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.006558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 830/1655] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:55.045957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499c91f-ee0e-42d9-be4d-ef0336c50f4b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.046585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499c91f-ee0e-42d9-be4d-ef0336c50f4b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.046585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499c91f-ee0e-42d9-be4d-ef0336c50f4b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.048390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 826/1656] 10.222.0.67 () {54 vars in 912 bytes} [Fri May 27 09:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:55.063888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.064497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.065019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.092512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499c91f-ee0e-42d9-be4d-ef0336c50f4b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.094792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a499c91f-ee0e-42d9-be4d-ef0336c50f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.201423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] MFA Rules not processed for user `76f6fdb7d7074ddba6170f110c750489`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:55.206348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.290558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499c91f-ee0e-42d9-be4d-ef0336c50f4b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.297542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.298346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.298980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.299498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.345392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.349043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.400950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 827/1657] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:55.411206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 831/1658] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:55.447664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.478867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3630cd-bb84-479e-8516-99090357c0ec service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.498569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53afa-053a-4327-bca8-0ee1ca27ceda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.499877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53afa-053a-4327-bca8-0ee1ca27ceda service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.500524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53afa-053a-4327-bca8-0ee1ca27ceda service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.502772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53afa-053a-4327-bca8-0ee1ca27ceda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.541027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53afa-053a-4327-bca8-0ee1ca27ceda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.545639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53afa-053a-4327-bca8-0ee1ca27ceda service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.586625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 828/1659] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:56.067701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.071292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:56.146403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19850bd-fbc7-47fe-a12f-898d6f9257e1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.168200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.170023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.170541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.171048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] PATH_INFO: `/v3/users/3d7d647f678a4cdbb3b07b55c97dea27` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.176076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7d647f678a4cdbb3b07b55c97dea27)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.189023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.543287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:56.578510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7d647f678a4cdbb3b07b55c97dea27'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:56.716383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a89a-4995-449f-b698-48b839221994 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.717765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a89a-4995-449f-b698-48b839221994 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.718725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a89a-4995-449f-b698-48b839221994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.750498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7d647f678a4cdbb3b07b55c97dea27'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:56.755342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7d647f678a4cdbb3b07b55c97dea27'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:56.758021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7d647f678a4cdbb3b07b55c97dea27'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:56.804497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-33d25fa0-cefa-4805-972f-b8fc694ca17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7d647f678a4cdbb3b07b55c97dea27'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:56.885855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5755a89a-4995-449f-b698-48b839221994 None None] MFA Rules not processed for user `99cb6b1fa268480bbf4a60f2464c878b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:56.894314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5755a89a-4995-449f-b698-48b839221994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:56.950117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 832/1660] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:36:56 2022] DELETE /identity/v3/users/3d7d647f678a4cdbb3b07b55c97dea27 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:56.952383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.952884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.957514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.047374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:57.053981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.292949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 833/1661] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:57.346018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 829/1662] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 632 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:57.676697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:57.680133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.746104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debf2d-3f27-48f1-bdcd-c3f8cab9b1d1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.747144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debf2d-3f27-48f1-bdcd-c3f8cab9b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.747144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debf2d-3f27-48f1-bdcd-c3f8cab9b1d1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.749244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 830/1663] 10.222.0.67 () {54 vars in 960 bytes} [Fri May 27 09:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:57.761882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81debf2d-3f27-48f1-bdcd-c3f8cab9b1d1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:57.764594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-81debf2d-3f27-48f1-bdcd-c3f8cab9b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.808483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81debf2d-3f27-48f1-bdcd-c3f8cab9b1d1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:57.820725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.821917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.822362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.822820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] PATH_INFO: `/v3/users/e9da410dc3e642f3839f4d9915eb9904` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.823628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1631e1-8e31-49be-b2ac-66d351b59b9c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:57.828147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9da410dc3e642f3839f4d9915eb9904)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.831340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.837374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4a1ef-96c3-4c09-8ec1-5c984b76590a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.839036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4a1ef-96c3-4c09-8ec1-5c984b76590a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.841757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4a1ef-96c3-4c09-8ec1-5c984b76590a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.841978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4a1ef-96c3-4c09-8ec1-5c984b76590a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.856899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:57.869944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4a1ef-96c3-4c09-8ec1-5c984b76590a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.872025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4a1ef-96c3-4c09-8ec1-5c984b76590a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.888677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 834/1664] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:57.891052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.892741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.893923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.941492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:57.943428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.080617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:58.096711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 835/1665] 10.222.0.67 () {58 vars in 1057 bytes} [Fri May 27 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:58.114346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.125469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9da410dc3e642f3839f4d9915eb9904'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.132818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a905a7-2821-47fb-9969-4cd4317a297e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:58.156800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:58.158100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.159785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.160273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.168418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.200837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9da410dc3e642f3839f4d9915eb9904'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.201529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9da410dc3e642f3839f4d9915eb9904'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.235276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9da410dc3e642f3839f4d9915eb9904'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.237301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-68a723c6-ae80-4340-bdef-ad6ad17f0bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9da410dc3e642f3839f4d9915eb9904'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.238912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:58.242142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:58.287876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 836/1666] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:58.315973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 831/1667] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:36:57 2022] DELETE /identity/v3/users/e9da410dc3e642f3839f4d9915eb9904 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:36:58.323227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.323677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.327358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.332920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.339079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.414404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc416-9fff-4e8e-bea9-efd4722958a8 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:58.430568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:58.448800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.706189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:58.707741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.708244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.710263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] PATH_INFO: `/v3/projects/ad2dc5a66f084d68bc9f6e8751306cec` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.712938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2dc5a66f084d68bc9f6e8751306cec)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:58.714918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: WARNING py.warnings [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:58.714918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: warnings.warn(msg) May 27 09:36:58.714918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: May 27 09:36:58.723438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:58.753176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 832/1668] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:58.783401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.788104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.068383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33832-22b3-46c0-9dfe-857a7e9e00dc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:59.110509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2dc5a66f084d68bc9f6e8751306cec', 'request_id': 'req-5852d390-b08f-49ec-90f2-90c305fcde16'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.221630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2dc5a66f084d68bc9f6e8751306cec', 'request_id': 'req-5852d390-b08f-49ec-90f2-90c305fcde16'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.241982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8937-addd-4d48-a18f-53004b345a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:59.243085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8937-addd-4d48-a18f-53004b345a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.243556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8937-addd-4d48-a18f-53004b345a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.244010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8937-addd-4d48-a18f-53004b345a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.282546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2dc5a66f084d68bc9f6e8751306cec', 'request_id': 'req-5852d390-b08f-49ec-90f2-90c305fcde16'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.312225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] The token cache is being invalidate because project ad2dc5a66f084d68bc9f6e8751306cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:59.313082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.315307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.325486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 837/1669] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:36:58 2022] DELETE /identity/v3/projects/ad2dc5a66f084d68bc9f6e8751306cec => generated 0 bytes in 989 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:36:59.327636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:59.331396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.511039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8937-addd-4d48-a18f-53004b345a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:59.518179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8937-addd-4d48-a18f-53004b345a91 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:59.595116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 833/1670] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:59.604052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852d390-b08f-49ec-90f2-90c305fcde16 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:59.627299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:59.630422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.630422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.630840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] PATH_INFO: `/v3/users/09786254e70541f0a8206bb3f900a318` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.640191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09786254e70541f0a8206bb3f900a318)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:59.644149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:59.829005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:00.035889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09786254e70541f0a8206bb3f900a318'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.117368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09786254e70541f0a8206bb3f900a318'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.118823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09786254e70541f0a8206bb3f900a318'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.119821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09786254e70541f0a8206bb3f900a318'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.160095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:00.167897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-32fc902b-3fd8-433a-a486-6c2a15acb16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09786254e70541f0a8206bb3f900a318'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.204044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 838/1671] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:36:59 2022] DELETE /identity/v3/users/09786254e70541f0a8206bb3f900a318 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:00.743187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9766ff-59a0-4ab5-b5f0-c69243366968 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.743509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9766ff-59a0-4ab5-b5f0-c69243366968 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.743825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9766ff-59a0-4ab5-b5f0-c69243366968 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.746163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 834/1672] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:37:00.755841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.756925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.757524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.785854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:00.788194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.917424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 839/1673] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:00.966217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9766ff-59a0-4ab5-b5f0-c69243366968 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:00.967882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f9766ff-59a0-4ab5-b5f0-c69243366968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.979959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:00.989811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.997467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9766ff-59a0-4ab5-b5f0-c69243366968 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:01.025524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:01.026701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.027231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.027742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.062792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:01.068805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:01.084000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 835/1674] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:01.181988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b510dc-9cfd-4993-ae18-e09427a4b3d0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:01.189125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:01.190669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.191754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.192200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] PATH_INFO: `/v3/projects/96bfdc24989c45e8b2ef6398aff9bd55` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.194213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bfdc24989c45e8b2ef6398aff9bd55)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:01.197307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:01.540860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bfdc24989c45e8b2ef6398aff9bd55', 'request_id': 'req-866f372e-3370-47ab-bd7f-1dd9b47562b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.604886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:01.606557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:01.622816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815d5e-ac4d-4a6d-b43f-5836e8d68817 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:01.688529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bfdc24989c45e8b2ef6398aff9bd55', 'request_id': 'req-866f372e-3370-47ab-bd7f-1dd9b47562b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.713583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:01.716643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.722114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.722114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] PATH_INFO: `/v3/projects/b5b6ee5a88a54b44983b2a34f26ef871` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.724469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b6ee5a88a54b44983b2a34f26ef871)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:01.728802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:01.769213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bfdc24989c45e8b2ef6398aff9bd55', 'request_id': 'req-866f372e-3370-47ab-bd7f-1dd9b47562b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.788863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] The token cache is being invalidate because project 96bfdc24989c45e8b2ef6398aff9bd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:01.789381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.792812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-866f372e-3370-47ab-bd7f-1dd9b47562b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.799865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 840/1675] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:00 2022] DELETE /identity/v3/projects/96bfdc24989c45e8b2ef6398aff9bd55 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:01.805200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecc783-f003-48b3-810e-00c747e9eee2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.805517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecc783-f003-48b3-810e-00c747e9eee2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.805757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecc783-f003-48b3-810e-00c747e9eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.852692 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-71ecc783-f003-48b3-810e-00c747e9eee2 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:01.856680 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-71ecc783-f003-48b3-810e-00c747e9eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:01.881807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 841/1676] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:01.890956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.891449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.891929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.996996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:01.999897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.007077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b6ee5a88a54b44983b2a34f26ef871', 'request_id': 'req-cdfae2ca-a839-4788-9263-5a2ccf26fa72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.014272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b6ee5a88a54b44983b2a34f26ef871', 'request_id': 'req-cdfae2ca-a839-4788-9263-5a2ccf26fa72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.021402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b6ee5a88a54b44983b2a34f26ef871', 'request_id': 'req-cdfae2ca-a839-4788-9263-5a2ccf26fa72'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.119937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 842/1677] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:02.125978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.137368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] The token cache is being invalidate because project b5b6ee5a88a54b44983b2a34f26ef871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:02.138035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.139120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.143363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 836/1678] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:01 2022] DELETE /identity/v3/projects/b5b6ee5a88a54b44983b2a34f26ef871 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:02.148018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.152809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.197827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226ccc6-45ce-4dc3-9efe-ac8bf5e08cc6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:02.209474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfae2ca-a839-4788-9263-5a2ccf26fa72 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:02.213158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:02.214399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.215945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.216714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.217952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:02.219991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:02.225278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203fd22-c197-4d15-af72-69dffbca2810 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:02.226114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:02.227529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.229782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.230268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] PATH_INFO: `/v3/users/ac6bf625a0eb4c55a2aba14da8ce3ef1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.232971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6bf625a0eb4c55a2aba14da8ce3ef1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:02.238407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:02.259687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 843/1679] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:02.267432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.268714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.271045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.312455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:02.386417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] MFA Rules not processed for user `82bf01c0cdbc48fa9b78933314039ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:02.388294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.580688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 844/1680] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:02.588732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.596301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.609969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6bf625a0eb4c55a2aba14da8ce3ef1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.655623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf8e80-38ac-4e05-aa25-058e0a337c25 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:02.662381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:02.663067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.663347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.663748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.665112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:02.670035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:02.783209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6bf625a0eb4c55a2aba14da8ce3ef1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.784115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6bf625a0eb4c55a2aba14da8ce3ef1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.827514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6bf625a0eb4c55a2aba14da8ce3ef1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.834193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d492e8b3-ae97-4477-b411-3b1b7fe6629e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6bf625a0eb4c55a2aba14da8ce3ef1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.849425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 845/1681] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:02 2022] POST /identity/v3/projects => generated 361 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:02.854333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.862666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.904731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 837/1682] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:02 2022] DELETE /identity/v3/users/ac6bf625a0eb4c55a2aba14da8ce3ef1 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:02.906337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.906629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.910828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.971682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] MFA Rules not processed for user `82bf01c0cdbc48fa9b78933314039ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:02.973569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.982791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:03.206221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042878b-18d1-44f3-8750-da0cc4c393f9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.231825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 838/1683] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:03.231825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.235258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.385575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d3ecc-b9f8-45f6-87ae-758201dfafde None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.398451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.399633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.400768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.401519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] PATH_INFO: `/v3/projects/57ab244a9243496aa70ec2c266004f45` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.403473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ab244a9243496aa70ec2c266004f45)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.403593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9772b2-d389-4ca2-9a7e-d2df6cb98657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.404191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9772b2-d389-4ca2-9a7e-d2df6cb98657 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.404515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9772b2-d389-4ca2-9a7e-d2df6cb98657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.405446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9772b2-d389-4ca2-9a7e-d2df6cb98657 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.406213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9772b2-d389-4ca2-9a7e-d2df6cb98657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.407298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.408370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9772b2-d389-4ca2-9a7e-d2df6cb98657 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.526006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 839/1684] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/users => generated 281 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:03.530293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdf85-4eea-4a23-91f2-ea9f07e1d425 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.530602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdf85-4eea-4a23-91f2-ea9f07e1d425 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.532136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdf85-4eea-4a23-91f2-ea9f07e1d425 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.535557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 840/1685] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:37:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:03.538115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cdf85-4eea-4a23-91f2-ea9f07e1d425 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.544050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b23cdf85-4eea-4a23-91f2-ea9f07e1d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.593486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ab244a9243496aa70ec2c266004f45', 'request_id': 'req-8fc8f868-5f7c-4faa-806c-67146662d700'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:03.665786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ab244a9243496aa70ec2c266004f45', 'request_id': 'req-8fc8f868-5f7c-4faa-806c-67146662d700'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:03.674013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ab244a9243496aa70ec2c266004f45', 'request_id': 'req-8fc8f868-5f7c-4faa-806c-67146662d700'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:03.714627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] The token cache is being invalidate because project 57ab244a9243496aa70ec2c266004f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:03.715147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:03.717931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:03.725445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 846/1686] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:02 2022] DELETE /identity/v3/projects/57ab244a9243496aa70ec2c266004f45 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:03.725445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.729066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cdf85-4eea-4a23-91f2-ea9f07e1d425 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.732706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.743025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.743901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.744052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.744260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.747446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.909799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.926611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8f868-5f7c-4faa-806c-67146662d700 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.931344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.939550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.940591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.941702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.942000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] PATH_INFO: `/v3/users/6c073ecc855b44a18451e01049930497` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.949296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c073ecc855b44a18451e01049930497)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.953922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.954632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 841/1687] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:03.955639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.957826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.979462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f76dae-8eb8-479c-b9d8-1c6d4850b45b service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.990304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00accbf-2cb0-496a-a68c-721dc305ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.991674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00accbf-2cb0-496a-a68c-721dc305ccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.992024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00accbf-2cb0-496a-a68c-721dc305ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.992548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00accbf-2cb0-496a-a68c-721dc305ccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.993613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00accbf-2cb0-496a-a68c-721dc305ccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.996113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00accbf-2cb0-496a-a68c-721dc305ccc9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.024889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 842/1688] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:04.026491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa40cf-dfdc-4660-a005-23edd79b9e31 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.026860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa40cf-dfdc-4660-a005-23edd79b9e31 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.027508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa40cf-dfdc-4660-a005-23edd79b9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.084148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-abaa40cf-dfdc-4660-a005-23edd79b9e31 None None] MFA Rules not processed for user `260ffef539f14b29b103ab0bfdeb0000`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.084148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-abaa40cf-dfdc-4660-a005-23edd79b9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.234987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c073ecc855b44a18451e01049930497'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:04.296254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 843/1689] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:04.297879 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.298265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.298551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.328728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c073ecc855b44a18451e01049930497'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:04.329583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c073ecc855b44a18451e01049930497'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:04.330432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c073ecc855b44a18451e01049930497'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:04.334632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.337158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.357189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c84ad52c-3762-4f08-89d2-03dbd447416e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c073ecc855b44a18451e01049930497'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:04.357951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 844/1690] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:04.373969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.375530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.388604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 847/1691] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:03 2022] DELETE /identity/v3/users/6c073ecc855b44a18451e01049930497 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:04.393723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52c622-578d-4074-a97a-73390215a613 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.393723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52c622-578d-4074-a97a-73390215a613 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.393723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52c622-578d-4074-a97a-73390215a613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.435941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529523ac-19cb-4322-88f0-35d6bb6f8e67 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.475333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-be52c622-578d-4074-a97a-73390215a613 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.484341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be52c622-578d-4074-a97a-73390215a613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.584570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 848/1692] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:04.592895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52c622-578d-4074-a97a-73390215a613 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.650733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.651817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.652901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.653197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.658854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.663919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52c622-578d-4074-a97a-73390215a613 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.665157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.696482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.700487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.704044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 845/1693] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:04.705571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.706902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.707765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.710861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.710977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:04.712705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.717845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e915-b512-4dc7-92d1-5a3b3d0ad61b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.728719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:04.769555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 849/1694] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:04.773689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.774092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.774381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.844092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.849766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.964681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06052-c5e1-46b7-b310-565e50d60c45 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.996750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.001398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.002020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.006793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.015214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:05.050267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 850/1695] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:05.050809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.072531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:05.080153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cbb96-9672-45e2-84ad-0fd0ea8428db None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.094580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.095684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.095980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.096261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] PATH_INFO: `/v3/projects/ae9115f695e1452a921e843bc9f11f6f/users/e96145f8e7cd4293aede044b238752bc/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.101826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.109693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.133557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9115f695e1452a921e843bc9f11f6f, user_id=e96145f8e7cd4293aede044b238752bc, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.136800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.155959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 846/1696] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:05.158735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.250912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eca166-d19a-48b7-b243-9c1aef2fefd4 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.264864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 851/1697] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:05 2022] PUT /identity/v3/projects/ae9115f695e1452a921e843bc9f11f6f/users/e96145f8e7cd4293aede044b238752bc/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:05.276829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.281249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:05.466473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab214df-94a1-401c-9abe-3447c1d1efd2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.481963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.482903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.483219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.483435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] PATH_INFO: `/v3/projects/827c8c4851b140ba8f4f9046db3e91c0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.485137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827c8c4851b140ba8f4f9046db3e91c0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.491182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.601568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911b25-338f-48c7-bfd4-5bbbf515ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.602665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911b25-338f-48c7-bfd4-5bbbf515ab20 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.602831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911b25-338f-48c7-bfd4-5bbbf515ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.603123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911b25-338f-48c7-bfd4-5bbbf515ab20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.603822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911b25-338f-48c7-bfd4-5bbbf515ab20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.605864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911b25-338f-48c7-bfd4-5bbbf515ab20 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.729009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827c8c4851b140ba8f4f9046db3e91c0', 'request_id': 'req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:05.765865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 847/1698] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:05 2022] POST /identity/v3/projects => generated 365 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:05.767809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.768118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.768402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.842678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] MFA Rules not processed for user `e96145f8e7cd4293aede044b238752bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:05.845011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:05.852299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827c8c4851b140ba8f4f9046db3e91c0', 'request_id': 'req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:05.863568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827c8c4851b140ba8f4f9046db3e91c0', 'request_id': 'req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:05.900400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] The token cache is being invalidate because project 827c8c4851b140ba8f4f9046db3e91c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:05.901836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:05.901836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:05.906414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 852/1699] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:05 2022] DELETE /identity/v3/projects/827c8c4851b140ba8f4f9046db3e91c0 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:05.906414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.914518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.092848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d6b6-b8e0-4ae6-9c37-dfba7deb8d74 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.104943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 848/1700] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:06.110005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.113235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.191532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:06.238848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.239412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.239698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.239978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] PATH_INFO: `/v3/projects/64ba96b0f8b740adb843fb745b7716bd` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.241373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ba96b0f8b740adb843fb745b7716bd)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.244433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.477222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6af5d-2438-4213-a84f-3afad8a688b7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.522706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.524473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.525322 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.526442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.530302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.536042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:06.548024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ba96b0f8b740adb843fb745b7716bd', 'request_id': 'req-44702f34-26fc-4a59-a7cf-bca89c408af2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:06.676928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ba96b0f8b740adb843fb745b7716bd', 'request_id': 'req-44702f34-26fc-4a59-a7cf-bca89c408af2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:06.684476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ba96b0f8b740adb843fb745b7716bd', 'request_id': 'req-44702f34-26fc-4a59-a7cf-bca89c408af2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:06.695662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:06.738510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] The token cache is being invalidate because project 64ba96b0f8b740adb843fb745b7716bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:06.739076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:06.749884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:06.757108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 853/1701] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:05 2022] DELETE /identity/v3/projects/64ba96b0f8b740adb843fb745b7716bd => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:06.760371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.763554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.763738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.771637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409fd4f-add0-4dea-b6f8-4fb4af8c8dcf service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.801097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 849/1702] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:37:06.805216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.806091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.806853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.875397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702f34-26fc-4a59-a7cf-bca89c408af2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.880213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:06.883514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b6231-177f-4578-9827-186fc818b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.884294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b6231-177f-4578-9827-186fc818b4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.884703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b6231-177f-4578-9827-186fc818b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.885058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b6231-177f-4578-9827-186fc818b4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.885862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b6231-177f-4578-9827-186fc818b4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.888118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b6231-177f-4578-9827-186fc818b4a3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.889670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.915932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 850/1703] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:06.920301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.922384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.978260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b416-b338-4430-9f6d-5cc4c5df07d5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.993195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659cfa1-cca7-407d-836e-d2d763d3d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.996652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659cfa1-cca7-407d-836e-d2d763d3d038 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.996652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659cfa1-cca7-407d-836e-d2d763d3d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.996652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659cfa1-cca7-407d-836e-d2d763d3d038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.996652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659cfa1-cca7-407d-836e-d2d763d3d038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.997517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659cfa1-cca7-407d-836e-d2d763d3d038 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.059909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 854/1704] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:06 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:07.071795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2836a-97e7-44c9-b0f6-0861faf237d9 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.076344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2836a-97e7-44c9-b0f6-0861faf237d9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.078710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2836a-97e7-44c9-b0f6-0861faf237d9 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.088767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 855/1705] 10.222.0.67 () {54 vars in 912 bytes} [Fri May 27 09:37:07 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:07.092282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2836a-97e7-44c9-b0f6-0861faf237d9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.100246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-efb2836a-97e7-44c9-b0f6-0861faf237d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.114691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 851/1706] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:06 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:07.116160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.116467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.116760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.191723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:07.194807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.399318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 852/1707] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:07.400238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.410220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2836a-97e7-44c9-b0f6-0861faf237d9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.427864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.429262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.429728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.433214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] PATH_INFO: `/v3/users/99cb6b1fa268480bbf4a60f2464c878b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.433342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05da7c-7b89-44c7-9a7d-262bdf647745 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.433419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cb6b1fa268480bbf4a60f2464c878b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.436938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.448930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6475b-ff11-4cab-b895-28ae018c0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.450247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6475b-ff11-4cab-b895-28ae018c0fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.450247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6475b-ff11-4cab-b895-28ae018c0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.450247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6475b-ff11-4cab-b895-28ae018c0fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.450929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6475b-ff11-4cab-b895-28ae018c0fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.453126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6475b-ff11-4cab-b895-28ae018c0fc9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.502939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 853/1708] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:07.505226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.505456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.505723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.576767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] MFA Rules not processed for user `76f6fdb7d7074ddba6170f110c750489`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:07.578035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.689030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 854/1709] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:07.690027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.726536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629e6f-92f6-4306-85eb-c89dda36b399 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.742835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.743537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.743825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.744130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.744848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.750068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.755267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:07.767010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cb6b1fa268480bbf4a60f2464c878b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.849813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cb6b1fa268480bbf4a60f2464c878b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.851461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cb6b1fa268480bbf4a60f2464c878b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.852351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cb6b1fa268480bbf4a60f2464c878b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.873414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 855/1710] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:07 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:07.875363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.886545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.890565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cb6b1fa268480bbf4a60f2464c878b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.946459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a5a82-4bcb-47de-9c76-784c7a009d36 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.948147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 856/1711] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:07 2022] DELETE /identity/v3/users/99cb6b1fa268480bbf4a60f2464c878b => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:07.950556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.952943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.011746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:08.124695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9e533-88a4-44d0-a30a-1134b4810461 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.133945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.137621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.137621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.137621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.137621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.138051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.161126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 857/1712] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:08.366775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:08.370178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.370178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.370178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.370178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.373166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:08.373166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.373166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.373661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.373825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 856/1713] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:08.373825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:08.373825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.373825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e63a4-44fc-495b-9b7f-c8d279111d17 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.374219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.374219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.374219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.374219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.375335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.375335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.375335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 857/1714] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:08.375778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fa7ff-0a2d-47b5-bc67-cf4f30b56c2a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.375872 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:08.375991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.375991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.375991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.375991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.376850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.398026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7d709-a2cc-4ccf-b26b-2388cc4540ee admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.401063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.402236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.402729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.403162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] PATH_INFO: `/v3/projects/0b72937977ad4c718766f830f2824d70/users/43f40f973e9c43a783237593a2050dae/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.414399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.419820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.436364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b72937977ad4c718766f830f2824d70, user_id=43f40f973e9c43a783237593a2050dae, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.440208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.442393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 858/1715] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:08.449620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:08.485961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235df82-5e4b-4c9c-940f-8988879ea72d service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.511196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98701a38-4584-41c8-8748-cff515c9e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.512038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98701a38-4584-41c8-8748-cff515c9e1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.512365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98701a38-4584-41c8-8748-cff515c9e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.512638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98701a38-4584-41c8-8748-cff515c9e1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.514504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98701a38-4584-41c8-8748-cff515c9e1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.518299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98701a38-4584-41c8-8748-cff515c9e1e5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.766611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 858/1716] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:08 2022] PUT /identity/v3/projects/0b72937977ad4c718766f830f2824d70/users/43f40f973e9c43a783237593a2050dae/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:08.767682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:08.793297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 859/1717] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:08 2022] POST /identity/v3/projects => generated 377 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:08.795906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.796197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.796501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.940057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] MFA Rules not processed for user `43f40f973e9c43a783237593a2050dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:08.942433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.061638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ea659-2fa0-4a53-8cb4-b3c723fb4f76 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:09.197461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 860/1718] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:09.197461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.281009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:09.282264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.282559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.282856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] PATH_INFO: `/v3/projects/15b5d8dd1e69404bac5e0ee235390bf1/users/1db0d4efc0384156ad8858cf1b466383/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.343515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b5d8dd1e69404bac5e0ee235390bf1, user_id=1db0d4efc0384156ad8858cf1b466383, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:09.346887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:09.388426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:09.412957 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c59af-28d2-4a84-ac04-ee19414dda8e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:09.430284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 859/1719] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:08 2022] PUT /identity/v3/projects/15b5d8dd1e69404bac5e0ee235390bf1/users/1db0d4efc0384156ad8858cf1b466383/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:09.446724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb1e5-db2e-49dd-94e0-875eb05f3e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:09.446724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb1e5-db2e-49dd-94e0-875eb05f3e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.446724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb1e5-db2e-49dd-94e0-875eb05f3e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.446724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb1e5-db2e-49dd-94e0-875eb05f3e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.447265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.447363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb1e5-db2e-49dd-94e0-875eb05f3e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:09.447363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb1e5-db2e-49dd-94e0-875eb05f3e40 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:09.597453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 861/1720] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:09 2022] POST /identity/v3/users => generated 289 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:09.607662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.608307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.608769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.655807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] MFA Rules not processed for user `9e8aada8bb9642319ea99af1f98b9f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:09.664404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958dc29-90d6-49a9-ba12-49e4f6f2748a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:09.664847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.680729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:09.681489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.684385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.685222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.687348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:09.697971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:09.889837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 860/1721] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:09 2022] POST /identity/v3/projects => generated 365 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:09.891748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.899835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.951002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 862/1722] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:09.955510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.997728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc1c9-5e6e-4e46-8836-e54e1d2dfba9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.127044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbdac-6169-45c5-9533-96cb8e6813bc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.137746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.154848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.156213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.157362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] PATH_INFO: `/v3/projects/d3c64b95f3e34f1cad1514679bf03692` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.159940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c64b95f3e34f1cad1514679bf03692)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:10.164414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:10.232262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:10.319152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.322034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.322034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.322034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.323268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:10.329673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:10.355150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 863/1723] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:10.356596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:10.373607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979b3d0-b978-4d14-a1ad-1f9f10c15e64 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.384350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaefc5c-ec39-4a30-9da9-ce9d646ae318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.385398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefc5c-ec39-4a30-9da9-ce9d646ae318 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.385678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefc5c-ec39-4a30-9da9-ce9d646ae318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.386049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefc5c-ec39-4a30-9da9-ce9d646ae318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.386914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaefc5c-ec39-4a30-9da9-ce9d646ae318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:10.389359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaefc5c-ec39-4a30-9da9-ce9d646ae318 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:10.430636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 864/1724] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:10.435885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.436710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.436913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.463534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:10.466897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] MFA Rules not processed for user `76f6fdb7d7074ddba6170f110c750489`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:10.468554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:10.480093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c64b95f3e34f1cad1514679bf03692', 'request_id': 'req-18483770-fdaf-4ddd-a53c-fb411fe4cd00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:10.504793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c64b95f3e34f1cad1514679bf03692', 'request_id': 'req-18483770-fdaf-4ddd-a53c-fb411fe4cd00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:10.516621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c64b95f3e34f1cad1514679bf03692', 'request_id': 'req-18483770-fdaf-4ddd-a53c-fb411fe4cd00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:10.654451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 865/1725] 10.222.0.40 () {58 vars in 1015 bytes} [Fri May 27 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:10.658639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] The token cache is being invalidate because project d3c64b95f3e34f1cad1514679bf03692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:10.658639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:10.658876 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:10.658964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:10.658964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 861/1726] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:09 2022] DELETE /identity/v3/projects/d3c64b95f3e34f1cad1514679bf03692 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:10.660136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:10.665773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:10.837860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49069-9e2e-4670-b5a9-a8688f9b5c02 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.843879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.844885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.845610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.846197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.847622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:10.850453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:10.951173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 866/1727] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:10 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:10.951173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:10.951913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:10.978791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de227126-c089-4088-9a93-4bef78e485de admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.984387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483770-fdaf-4ddd-a53c-fb411fe4cd00 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.996537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.997527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.997837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.998047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] PATH_INFO: `/v3/projects/15b5d8dd1e69404bac5e0ee235390bf1/users/1db0d4efc0384156ad8858cf1b466383/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.000313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b5d8dd1e69404bac5e0ee235390bf1, user_id=1db0d4efc0384156ad8858cf1b466383, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.005542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.006705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.007398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.007690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.007998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.012741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.043420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 867/1728] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:10 2022] PUT /identity/v3/projects/15b5d8dd1e69404bac5e0ee235390bf1/users/1db0d4efc0384156ad8858cf1b466383/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:11.043420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.051756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.133164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:11.170858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.177107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d9f9a-120a-48b8-a02c-23fa1a238324 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.220369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 862/1729] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:11.224356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.224610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.224755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.284835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:11.294326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.347150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 863/1730] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:11.347150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.347150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.348297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654bc1a-8572-400b-ba54-32e8aa68784e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.368665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:11.374458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.378855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.381046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.381364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.388483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.395116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.437358 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 868/1731] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:11.438387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.453627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.534468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ceed22-1e2f-43f1-ae45-b41395a62bd3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.555139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818969e-c3e5-4ee3-9fc6-ee75eb73a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.557252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818969e-c3e5-4ee3-9fc6-ee75eb73a157 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.563179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818969e-c3e5-4ee3-9fc6-ee75eb73a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.563179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818969e-c3e5-4ee3-9fc6-ee75eb73a157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.563179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818969e-c3e5-4ee3-9fc6-ee75eb73a157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.575235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818969e-c3e5-4ee3-9fc6-ee75eb73a157 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.635029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 869/1732] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:11.637356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f172e-689b-4a13-8445-efb1b67f49d3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.637860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f172e-689b-4a13-8445-efb1b67f49d3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.638300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f172e-689b-4a13-8445-efb1b67f49d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.721955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fb1f172e-689b-4a13-8445-efb1b67f49d3 None None] MFA Rules not processed for user `1db0d4efc0384156ad8858cf1b466383`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:11.723283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fb1f172e-689b-4a13-8445-efb1b67f49d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.922199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 870/1733] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:11.933004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec17cc-447d-4be4-98bc-a34c3352656c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.933324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec17cc-447d-4be4-98bc-a34c3352656c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.933580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec17cc-447d-4be4-98bc-a34c3352656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.957899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-49ec17cc-447d-4be4-98bc-a34c3352656c None None] MFA Rules not processed for user `82bf01c0cdbc48fa9b78933314039ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:11.959198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-49ec17cc-447d-4be4-98bc-a34c3352656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.985138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c644287-72e9-4b92-ac23-778cba97fca1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.993070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.994238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.995634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.996500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.001684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.049170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.052202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.077203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 871/1734] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:12.080280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26532d5-5b09-433d-ba10-b51fbe2a2dfe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.080665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26532d5-5b09-433d-ba10-b51fbe2a2dfe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.080932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26532d5-5b09-433d-ba10-b51fbe2a2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.081377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 864/1735] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:12.082384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.106822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:12.113056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921186cf-cc7f-431e-a589-71588c29167b service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.124052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.126536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.126864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.127102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] PATH_INFO: `/v3/projects/fe6742bb00e44ac187e009d91d755a79/users/6d075037947a44fe80a62433b87cac65/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.130852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e26532d5-5b09-433d-ba10-b51fbe2a2dfe None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:12.132729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e26532d5-5b09-433d-ba10-b51fbe2a2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.162753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 872/1736] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:12.165886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.166196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.166481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.171861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6742bb00e44ac187e009d91d755a79, user_id=6d075037947a44fe80a62433b87cac65, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.189360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.291998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 865/1737] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:12 2022] PUT /identity/v3/projects/fe6742bb00e44ac187e009d91d755a79/users/6d075037947a44fe80a62433b87cac65/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:12.292856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.352276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] MFA Rules not processed for user `415775dc8e6a484d8894bdeaab4da631`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:12.352276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.483212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb71b6-ca8b-478d-906c-09ade0de3d55 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.501908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.503383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.503719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.504054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] PATH_INFO: `/v3/projects/dbdfd62951b64add801af7a3b0238739/users/8a178b74883c461290c810bb5c5e9cbc/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.543675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdfd62951b64add801af7a3b0238739, user_id=8a178b74883c461290c810bb5c5e9cbc, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.550383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.562933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 873/1738] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:12.562933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.562933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.667167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 866/1739] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:12 2022] PUT /identity/v3/projects/dbdfd62951b64add801af7a3b0238739/users/8a178b74883c461290c810bb5c5e9cbc/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:12.667661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.704014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a43bb-ae9d-4b8e-835e-4af7e36985b2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.882948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.883526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.883810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.884090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.894513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fe874-ed1d-4366-8808-77c5d7c589b3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.905499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.905926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.906222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.906505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.907276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:12.907732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.909571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7ade0-da59-4408-8de7-7ff7af0f47be admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.958429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 867/1740] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:12.958429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.958429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.958429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.974762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:13.037519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] MFA Rules not processed for user `6d075037947a44fe80a62433b87cac65`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:13.038807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.094658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.100076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.146918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 874/1741] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:13.147833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.155893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.202161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 868/1742] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:13.203115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.229129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceede767-d4c8-4618-a90d-8630891023c1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.243115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.243816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.244095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.244425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.245181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.247114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.287689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 869/1743] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:13.287689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.308780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddce17-6d08-4337-92b5-c44cdd0eb601 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.314314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.317596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.317596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.317596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.317596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.318793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.361324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:13.491496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f05e3c-6cd9-4eb1-af8d-69e716aca3d1 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.501609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.502254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.502570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.509655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.568254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 870/1744] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:13.568254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.699103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fac00-956d-49d2-8ac4-139060dbc9bf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.704775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.706259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.706592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.706990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.708546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.710765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.843755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.845809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.862450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 871/1745] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/projects => generated 377 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:13.863702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.886287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 875/1746] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:13.897805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.926419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefc9dc-5cca-4dcb-9efc-5ed0ce71fa7f service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.976360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.102566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.137938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.138629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.138916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.139197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.147569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122b0a-bace-4557-a9ad-d3afb24d89e9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.150807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:14.159234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.160424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.160532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.160804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] PATH_INFO: `/v3/projects/dbdfd62951b64add801af7a3b0238739/users/8a178b74883c461290c810bb5c5e9cbc/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.176081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdfd62951b64add801af7a3b0238739, user_id=8a178b74883c461290c810bb5c5e9cbc, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.179037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.208218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.238518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 872/1747] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:13 2022] PUT /identity/v3/projects/dbdfd62951b64add801af7a3b0238739/users/8a178b74883c461290c810bb5c5e9cbc/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:14.259828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.498048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.505272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.563445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 876/1748] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:14.565451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.574027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036a1e-7b90-4751-8386-d9d93fda19f3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.581415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6282127-9e18-4b08-8f3c-dc745cfa0a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.582295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282127-9e18-4b08-8f3c-dc745cfa0a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.582914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282127-9e18-4b08-8f3c-dc745cfa0a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.598327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282127-9e18-4b08-8f3c-dc745cfa0a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.599742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6282127-9e18-4b08-8f3c-dc745cfa0a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.613109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6282127-9e18-4b08-8f3c-dc745cfa0a8a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.640994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f3ec-77cb-443c-9e05-5567e82e3854 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.686968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.687975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.688291 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.688857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.690211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.715092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.740571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.837461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 873/1749] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/users => generated 294 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:14.840836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.841743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.843523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.870214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 877/1750] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/users => generated 295 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:14.875500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.931933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c864a0-b751-42c6-8183-4da95f25364b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.976493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] MFA Rules not processed for user `8a178b74883c461290c810bb5c5e9cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:14.983242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.984774 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:14.989087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.989389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.989701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.990484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.999889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.055576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 878/1751] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:15.064640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:15.073330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.134667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8bbb-3cd5-4246-87b0-a25cc5c5128b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.169516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.172826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.173083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.174930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.179225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.183327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.216010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 879/1752] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:15.217167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.248140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd61949-8f89-48c3-94f3-a767a754475b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.256104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.257274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.257571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.257897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.258756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.261414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.288624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 874/1753] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:15.289458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.345948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 880/1754] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:15.348622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.354964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4fecf-bbc7-47cf-8648-35701c84d2d1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.377590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.386756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.389209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.389209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.389209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] PATH_INFO: `/v3/projects/ce40c856a6194d0b8fcfb1085a5da0fb/users/f759007cfc504ec797e6bd5b6bf161c7/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.455415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce40c856a6194d0b8fcfb1085a5da0fb, user_id=f759007cfc504ec797e6bd5b6bf161c7, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.465543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.608679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 875/1755] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:15 2022] PUT /identity/v3/projects/ce40c856a6194d0b8fcfb1085a5da0fb/users/f759007cfc504ec797e6bd5b6bf161c7/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:15.608679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.655390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3208725-e5aa-43f5-9a03-02d461762ff2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.807818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:15.821284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.822076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.822494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.822977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.873083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ba526-652f-4038-8da2-effdfe28df8c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.889000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2941fd-248d-4411-b704-56cb8b699f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.890105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2941fd-248d-4411-b704-56cb8b699f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.890494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2941fd-248d-4411-b704-56cb8b699f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.890950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2941fd-248d-4411-b704-56cb8b699f8b admin admin] PATH_INFO: `/v3/projects/66b6ad5315b045f6aa0f6e79409545d4/users/3aca401f93dc4fa2b0c18872435c32a9/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.938175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2941fd-248d-4411-b704-56cb8b699f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b6ad5315b045f6aa0f6e79409545d4, user_id=3aca401f93dc4fa2b0c18872435c32a9, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.943074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2941fd-248d-4411-b704-56cb8b699f8b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.027660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:16.046355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.047894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.063476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 881/1756] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:16.065208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.108222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 876/1757] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:15 2022] PUT /identity/v3/projects/66b6ad5315b045f6aa0f6e79409545d4/users/3aca401f93dc4fa2b0c18872435c32a9/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:16.117794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71627-ae2c-4301-ad50-c3b20006f7a3 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.119520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.120060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.120871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.196112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] MFA Rules not processed for user `3aca401f93dc4fa2b0c18872435c32a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:16.197672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.481094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839beadf-e56b-444c-8fdf-e2436fa8cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.482272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839beadf-e56b-444c-8fdf-e2436fa8cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.488620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839beadf-e56b-444c-8fdf-e2436fa8cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.489240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839beadf-e56b-444c-8fdf-e2436fa8cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.499733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839beadf-e56b-444c-8fdf-e2436fa8cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.502029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839beadf-e56b-444c-8fdf-e2436fa8cb25 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.565060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 882/1758] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:16.573058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f562b01-b09e-475a-8fb2-1a48f5493e92 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.573058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f562b01-b09e-475a-8fb2-1a48f5493e92 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.573058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f562b01-b09e-475a-8fb2-1a48f5493e92 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.574668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 883/1759] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:37:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:16.576378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f562b01-b09e-475a-8fb2-1a48f5493e92 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.618585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 877/1760] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:16.624070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.627897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f562b01-b09e-475a-8fb2-1a48f5493e92 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.674007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105d6fc-6f84-44da-ae56-796170e18a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.680011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105d6fc-6f84-44da-ae56-796170e18a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.684970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105d6fc-6f84-44da-ae56-796170e18a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.685514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105d6fc-6f84-44da-ae56-796170e18a22 admin admin] PATH_INFO: `/v3/projects/ce40c856a6194d0b8fcfb1085a5da0fb/users/f759007cfc504ec797e6bd5b6bf161c7/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.694469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105d6fc-6f84-44da-ae56-796170e18a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce40c856a6194d0b8fcfb1085a5da0fb, user_id=f759007cfc504ec797e6bd5b6bf161c7, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.705176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e015bb-554b-498c-a149-d186a1e18a8e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.718083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbd662-f64f-4f3f-b4f8-8b13ef226d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.721366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbd662-f64f-4f3f-b4f8-8b13ef226d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.722298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbd662-f64f-4f3f-b4f8-8b13ef226d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.723643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbd662-f64f-4f3f-b4f8-8b13ef226d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.724661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbd662-f64f-4f3f-b4f8-8b13ef226d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.724770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105d6fc-6f84-44da-ae56-796170e18a22 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.727906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbd662-f64f-4f3f-b4f8-8b13ef226d27 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.782105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 884/1761] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:16 2022] PUT /identity/v3/projects/ce40c856a6194d0b8fcfb1085a5da0fb/users/f759007cfc504ec797e6bd5b6bf161c7/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:16.785721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.788881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.789317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.846833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:16.852959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.978545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 878/1762] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/projects => generated 389 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:16.980758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.983412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.985565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.075527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 885/1763] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:17.077640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.177398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] MFA Rules not processed for user `f759007cfc504ec797e6bd5b6bf161c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:17.179241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.279278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2011fe-24d6-4744-9721-23fac377929b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.374178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:17.479689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 879/1764] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:17.481748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.489053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.492585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.494095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.495099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.497947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.515803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.521488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:17.681828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 886/1765] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:17 2022] POST /identity/v3/users => generated 301 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:17.684432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.759014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade549c-870d-48b1-92de-e2cb05926907 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.788754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.789447 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.789737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.790019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.821671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.823680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.867875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 880/1766] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:17.869005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.903535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511ea3b-b5d9-4a89-8641-0ce060dc462d service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.921807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.922510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.922840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.923077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.923833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.930719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.962153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 881/1767] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:17.971175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.978534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5368d46-0cdd-43f4-9f63-8b49952ff196 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.984219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.985332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.985830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.986127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] PATH_INFO: `/v3/projects/aae5ff6b43ad497f8710b0637d578a40/users/1bd0d140d2654125be969890ab0cde98/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.989070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8ee3-a021-4e21-8f3c-465abb9002f2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.001936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.003187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.003477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.003766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.011627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae5ff6b43ad497f8710b0637d578a40, user_id=1bd0d140d2654125be969890ab0cde98, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.016412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.156763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 882/1768] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:17 2022] PUT /identity/v3/projects/aae5ff6b43ad497f8710b0637d578a40/users/1bd0d140d2654125be969890ab0cde98/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:18.161098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.221411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.226933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.274386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 887/1769] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:18.507765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1476d-976d-4e69-8e4a-cb7a5f521c06 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.523824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefac0a-f098-4956-88cb-5462b910f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.525421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefac0a-f098-4956-88cb-5462b910f6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.525850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefac0a-f098-4956-88cb-5462b910f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.526145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefac0a-f098-4956-88cb-5462b910f6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.526897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefac0a-f098-4956-88cb-5462b910f6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.528920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefac0a-f098-4956-88cb-5462b910f6a0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.566787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 883/1770] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:18.569655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.588892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6246c-523d-493e-a4ed-1b667df7463f service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.609480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.610806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.613202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.613202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] PATH_INFO: `/v3/projects/aae5ff6b43ad497f8710b0637d578a40/users/1bd0d140d2654125be969890ab0cde98/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.624100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae5ff6b43ad497f8710b0637d578a40, user_id=1bd0d140d2654125be969890ab0cde98, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.639351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.679138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 888/1771] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:18 2022] PUT /identity/v3/projects/aae5ff6b43ad497f8710b0637d578a40/users/1bd0d140d2654125be969890ab0cde98/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:18.696147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.696147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.696453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.797265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] MFA Rules not processed for user `1bd0d140d2654125be969890ab0cde98`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:18.798762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.968786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.130270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 884/1772] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:19.162739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.282765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a4e2-58d0-46bb-9fcd-e81316d8885d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.308003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.309394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.309803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.310290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] PATH_INFO: `/v3/users/43f40f973e9c43a783237593a2050dae` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.312403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f40f973e9c43a783237593a2050dae)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.316078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.339720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:19.402259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce3da0-87ce-4255-953d-2d26eb5cafb9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.408102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a793b-80b6-41c6-b02e-16330b4953b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.413271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a793b-80b6-41c6-b02e-16330b4953b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.413271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a793b-80b6-41c6-b02e-16330b4953b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.413271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a793b-80b6-41c6-b02e-16330b4953b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.423543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a793b-80b6-41c6-b02e-16330b4953b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.425919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a793b-80b6-41c6-b02e-16330b4953b9 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.454512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 885/1773] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:19.470983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:19.601051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f40f973e9c43a783237593a2050dae'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.742712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f40f973e9c43a783237593a2050dae'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.743806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f40f973e9c43a783237593a2050dae'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.744914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f40f973e9c43a783237593a2050dae'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.815711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f40f973e9c43a783237593a2050dae'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.872467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 889/1774] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:18 2022] DELETE /identity/v3/users/43f40f973e9c43a783237593a2050dae => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:19.884185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.885593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.886106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.943621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:19.947762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.066871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 886/1775] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:20.385919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.389771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.417125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.419644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.483092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be634f4b-f58c-4442-97b1-90ce354a530f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.537744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.545383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.545977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.546456 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] PATH_INFO: `/v3/users/3aca401f93dc4fa2b0c18872435c32a9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.556800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aca401f93dc4fa2b0c18872435c32a9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.572969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.726141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299b4e-34bf-42d7-97a3-412e9f796e09 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.739396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72618ba-cf1f-4e4d-88ae-4ffac867d005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.763038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72618ba-cf1f-4e4d-88ae-4ffac867d005 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.763903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72618ba-cf1f-4e4d-88ae-4ffac867d005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.764877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72618ba-cf1f-4e4d-88ae-4ffac867d005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.843867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72618ba-cf1f-4e4d-88ae-4ffac867d005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.849218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72618ba-cf1f-4e4d-88ae-4ffac867d005 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.922412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 890/1776] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:20.997637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aca401f93dc4fa2b0c18872435c32a9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.143402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aca401f93dc4fa2b0c18872435c32a9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.144836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aca401f93dc4fa2b0c18872435c32a9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.190691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aca401f93dc4fa2b0c18872435c32a9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.195903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aca401f93dc4fa2b0c18872435c32a9'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.265696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 887/1777] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:20 2022] DELETE /identity/v3/users/3aca401f93dc4fa2b0c18872435c32a9 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:21.273440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.273798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.274653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.332564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:21.339641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.490397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:21.540773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 891/1778] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:22.322308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.324671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.606948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58653-99ee-438a-bb16-77a18c48f34d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.629642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf3010-1fc6-4cc8-8dbc-d152eec19381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.630659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf3010-1fc6-4cc8-8dbc-d152eec19381 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.631062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf3010-1fc6-4cc8-8dbc-d152eec19381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.631348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf3010-1fc6-4cc8-8dbc-d152eec19381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.669996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf3010-1fc6-4cc8-8dbc-d152eec19381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.689320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf3010-1fc6-4cc8-8dbc-d152eec19381 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.738556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 888/1779] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:23.581189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.581189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.627448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:23.780741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41739d-602b-4f7a-8d2e-e0f49a94fb15 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.781521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41739d-602b-4f7a-8d2e-e0f49a94fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.781521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41739d-602b-4f7a-8d2e-e0f49a94fb15 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.786111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f356b5-e6ab-4f2b-a753-12cbb0304496 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.788487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 889/1780] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:37:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:23.802960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.808083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.810938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.813705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.824193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.088462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.089497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.089920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.090404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.092587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.133724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 892/1781] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:24.135362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.140432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.180732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.183723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.207537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef990-db64-45b1-8462-8ea0a7e866eb service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.227571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.230988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.233050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.439799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] PATH_INFO: `/v3/projects/0b72937977ad4c718766f830f2824d70` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.439799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b72937977ad4c718766f830f2824d70)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.439799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.511470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 890/1782] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:24.587504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.591238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.633676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b72937977ad4c718766f830f2824d70', 'request_id': 'req-ac070d03-e5d8-4067-b846-1840e4c57380'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.635167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b21d1-a77b-4704-bd80-660214d2cba9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.768115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b72937977ad4c718766f830f2824d70', 'request_id': 'req-ac070d03-e5d8-4067-b846-1840e4c57380'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.794268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b72937977ad4c718766f830f2824d70', 'request_id': 'req-ac070d03-e5d8-4067-b846-1840e4c57380'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.860396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] The token cache is being invalidate because project 0b72937977ad4c718766f830f2824d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:24.866879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.887474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.896187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 893/1783] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:24 2022] DELETE /identity/v3/projects/0b72937977ad4c718766f830f2824d70 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:24.902313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.905704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.013406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.015281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.019028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.020959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.044370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.099670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.118521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775680b-cbbf-4bfc-a835-46a35ac5f2f5 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.206010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 891/1784] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:25.219151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac070d03-e5d8-4067-b846-1840e4c57380 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.230854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.231716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.232384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.232980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] PATH_INFO: `/v3/users/8a178b74883c461290c810bb5c5e9cbc` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.236222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a178b74883c461290c810bb5c5e9cbc)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.274510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.814494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a178b74883c461290c810bb5c5e9cbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.989072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a178b74883c461290c810bb5c5e9cbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.990567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a178b74883c461290c810bb5c5e9cbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.996994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a178b74883c461290c810bb5c5e9cbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.032079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a178b74883c461290c810bb5c5e9cbc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.067982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 894/1785] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:24 2022] DELETE /identity/v3/users/8a178b74883c461290c810bb5c5e9cbc => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:26.586347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.587223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.587223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.634451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] MFA Rules not processed for user `9e8aada8bb9642319ea99af1f98b9f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.636611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.653192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:26.724393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 892/1786] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.879952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.886112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.016505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f759a9a-cc44-42b5-9643-824bdebdb35c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.023002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.023968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.024255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.024694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] PATH_INFO: `/v3/projects/66b6ad5315b045f6aa0f6e79409545d4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.026385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b6ad5315b045f6aa0f6e79409545d4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.028981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.205886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:27.334699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.336144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.350665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fbb2f-cd3d-4744-bd9f-0debec5745cc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.355142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b6ad5315b045f6aa0f6e79409545d4', 'request_id': 'req-ed343c6a-3d9c-4ff6-965d-b2821308be46'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.447745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.448754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.449094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.449554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] PATH_INFO: `/v3/projects/dbdfd62951b64add801af7a3b0238739` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.451805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdfd62951b64add801af7a3b0238739)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.455687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.504033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b6ad5315b045f6aa0f6e79409545d4', 'request_id': 'req-ed343c6a-3d9c-4ff6-965d-b2821308be46'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.513977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b6ad5315b045f6aa0f6e79409545d4', 'request_id': 'req-ed343c6a-3d9c-4ff6-965d-b2821308be46'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.534171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] The token cache is being invalidate because project 66b6ad5315b045f6aa0f6e79409545d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:27.535034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.536837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ed343c6a-3d9c-4ff6-965d-b2821308be46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.539530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 895/1787] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:26 2022] DELETE /identity/v3/projects/66b6ad5315b045f6aa0f6e79409545d4 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:27.541427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.542356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.542874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.566891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] MFA Rules not processed for user `415775dc8e6a484d8894bdeaab4da631`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.577078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.632385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdfd62951b64add801af7a3b0238739', 'request_id': 'req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.639078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdfd62951b64add801af7a3b0238739', 'request_id': 'req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.647334 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdfd62951b64add801af7a3b0238739', 'request_id': 'req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.652370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 896/1788] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:27.653794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.655887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.672969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3366-6a86-42d2-a03f-2233559dc30b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.765219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.766906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.768233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.783381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] PATH_INFO: `/v3/users/1bd0d140d2654125be969890ab0cde98` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.783381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd0d140d2654125be969890ab0cde98)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.783381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.846293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] The token cache is being invalidate because project dbdfd62951b64add801af7a3b0238739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:27.846293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.846293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2ff870bf-1ca1-4a36-abc2-d3def1a5209d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:27.846293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 893/1789] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:27 2022] DELETE /identity/v3/projects/dbdfd62951b64add801af7a3b0238739 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:27.850357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a393-d714-4bbc-a1f8-7aa7092e1605 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.850936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a393-d714-4bbc-a1f8-7aa7092e1605 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.851227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5a393-d714-4bbc-a1f8-7aa7092e1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.883952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0ff5a393-d714-4bbc-a1f8-7aa7092e1605 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.885189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0ff5a393-d714-4bbc-a1f8-7aa7092e1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.896542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 894/1790] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:27.913537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.913923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.914280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.968735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.968735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.968735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 895/1791] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:27.970561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.990061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f63709-771d-4c67-ba21-d2bc15d974b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.996128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.996861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.997135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.997417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.998939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:27.998939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.000204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.015337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 896/1792] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:28.027191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.041339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ce36c-2982-4f5f-8d01-b1d4df110d17 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.050994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.052173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.052734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.058611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.058611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.058611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.169271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd0d140d2654125be969890ab0cde98'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:28.183703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:28.192115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 897/1793] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:28 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:28.198695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.282304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd0d140d2654125be969890ab0cde98'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:28.284522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd0d140d2654125be969890ab0cde98'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:28.287628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd0d140d2654125be969890ab0cde98'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:28.325949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd0d140d2654125be969890ab0cde98'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:28.326525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2abf3-a81e-44ce-9758-2199fc993c3e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.338172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.339535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.339878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.340816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.341601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.352790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.362006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 897/1794] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:27 2022] DELETE /identity/v3/users/1bd0d140d2654125be969890ab0cde98 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:28.477179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 898/1795] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:28 2022] POST /identity/v3/users => generated 282 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:28.481728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.484520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:28.610010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d8ab-9fc9-4171-8141-4d1375c0b892 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.618140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.619630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.620729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.621211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.622219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.624118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.627219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.630193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:28.641170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 898/1796] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:28.642863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.670814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759990aa-a92d-4981-8828-f76b7d41c52b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.673982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406683ac-8323-4f6c-97dd-8d0cfdf43140 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.679531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.681342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.682241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.682993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] PATH_INFO: `/v3/users/e96145f8e7cd4293aede044b238752bc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.685925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96145f8e7cd4293aede044b238752bc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.686245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.687059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.687467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.687928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.688824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.691350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.692419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.711800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 899/1797] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:28.713360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.726866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962694d-3fa2-495b-ab13-4c48fed62ee7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.733416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b2f7a-5f7b-4a1f-acc7-f1bab709e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.734744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b2f7a-5f7b-4a1f-acc7-f1bab709e0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.735088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b2f7a-5f7b-4a1f-acc7-f1bab709e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.735450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b2f7a-5f7b-4a1f-acc7-f1bab709e0bb admin admin] PATH_INFO: `/v3/projects/28f47dab199d42b8a70987018743b2ab/users/0811768e6e4747e19531f9c215e18847/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.763987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b2f7a-5f7b-4a1f-acc7-f1bab709e0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f47dab199d42b8a70987018743b2ab, user_id=0811768e6e4747e19531f9c215e18847, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.767730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b2f7a-5f7b-4a1f-acc7-f1bab709e0bb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.912732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 900/1798] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:28 2022] PUT /identity/v3/projects/28f47dab199d42b8a70987018743b2ab/users/0811768e6e4747e19531f9c215e18847/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:28.924370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd578768-4394-4016-a335-75566c0ab84a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.925687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd578768-4394-4016-a335-75566c0ab84a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.926036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd578768-4394-4016-a335-75566c0ab84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.961280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fd578768-4394-4016-a335-75566c0ab84a None None] MFA Rules not processed for user `0811768e6e4747e19531f9c215e18847`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:28.962665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fd578768-4394-4016-a335-75566c0ab84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.043439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 901/1799] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:29.055778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd578768-4394-4016-a335-75566c0ab84a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.071281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96145f8e7cd4293aede044b238752bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.207844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96145f8e7cd4293aede044b238752bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.210059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96145f8e7cd4293aede044b238752bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.241600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd578768-4394-4016-a335-75566c0ab84a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.254622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96145f8e7cd4293aede044b238752bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.257643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-05db0b7c-b3b9-4ebd-b784-d918b7abcdc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96145f8e7cd4293aede044b238752bc'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.261596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.263612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.263930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.264497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.276085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.278364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.292346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 899/1800] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:28 2022] DELETE /identity/v3/users/e96145f8e7cd4293aede044b238752bc => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:29.297625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.299134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.299624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.345299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:29.347462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.458819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 902/1801] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/projects => generated 363 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:29.460952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.464666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.481336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 900/1802] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:29.486841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.492751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.563000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bb64a-51f1-4b3d-92af-62dc66f5b937 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.785106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4f0ee-0bf4-4d2e-bd9b-3accf96d8edf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.814014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.815996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.816370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.819436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.819436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.819436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.848634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.850563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.851311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.851883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] PATH_INFO: `/v3/projects/aae5ff6b43ad497f8710b0637d578a40` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.853617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae5ff6b43ad497f8710b0637d578a40)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.855908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.984212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 903/1803] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/users => generated 288 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:29.986521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.989265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:30.079084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae5ff6b43ad497f8710b0637d578a40', 'request_id': 'req-69d84d0d-3672-4208-a271-c687cb8fd434'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.092688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae5ff6b43ad497f8710b0637d578a40', 'request_id': 'req-69d84d0d-3672-4208-a271-c687cb8fd434'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.108378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae5ff6b43ad497f8710b0637d578a40', 'request_id': 'req-69d84d0d-3672-4208-a271-c687cb8fd434'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.116178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9f37-7766-4921-a9e5-8a924a737476 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.194522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552963c1-02ef-4ec8-ae4d-04c4e77af534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.196069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552963c1-02ef-4ec8-ae4d-04c4e77af534 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.198047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552963c1-02ef-4ec8-ae4d-04c4e77af534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.198777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552963c1-02ef-4ec8-ae4d-04c4e77af534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.232593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] The token cache is being invalidate because project aae5ff6b43ad497f8710b0637d578a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:30.232891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.238859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.238859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 901/1804] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:29 2022] DELETE /identity/v3/projects/aae5ff6b43ad497f8710b0637d578a40 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:30.240474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.242128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:30.331184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552963c1-02ef-4ec8-ae4d-04c4e77af534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.334319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552963c1-02ef-4ec8-ae4d-04c4e77af534 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.344693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d84d0d-3672-4208-a271-c687cb8fd434 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.350358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.351069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.351518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.351798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.352618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.354380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.367115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 904/1805] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:30.369430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 902/1806] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:30.370262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a26305-abc5-4e4e-b1d2-72aa4b91811c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.370570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a26305-abc5-4e4e-b1d2-72aa4b91811c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.373074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a26305-abc5-4e4e-b1d2-72aa4b91811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.373267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.392918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bb05f-3bd9-428b-a403-68eeae08ebfd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.393398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-22a26305-abc5-4e4e-b1d2-72aa4b91811c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:30.395078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22a26305-abc5-4e4e-b1d2-72aa4b91811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:30.406126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.406126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.406126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.406126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] PATH_INFO: `/v3/projects/fc426f6694b144a5b926aa60918af4ef/users/43f8e9cedc5445da8fade24895ba4039/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.406742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 905/1807] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:30.414233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.414714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.415674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.428942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc426f6694b144a5b926aa60918af4ef, user_id=43f8e9cedc5445da8fade24895ba4039, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.431904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.455757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:30.457147 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:30.470499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 906/1808] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:30.472243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.481813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301923-37de-4b5f-80f0-2a9dde4c167c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.487620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.488224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.488572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.488920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.489823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:30.490249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.492340 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.507672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 907/1809] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:30.591851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.608482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e398a-36de-4b61-96d3-febf9d0caf83 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.615987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.616777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.617066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.617347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.618053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.620535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.415533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 903/1810] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:30 2022] PUT /identity/v3/projects/fc426f6694b144a5b926aa60918af4ef/users/43f8e9cedc5445da8fade24895ba4039/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:31.420692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.464517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 908/1811] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:30 2022] POST /identity/v3/projects => generated 379 bytes in 872 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:31.469139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.518274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24af27-a3f4-4198-b4ef-07df91c87718 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.567179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c51b81-b898-46bc-91e8-e9f954a000cc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.574261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.575390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.575878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.576447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.586942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.587645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.592234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.592234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.592513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.592614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.592614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.594980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.604859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 904/1812] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:31.609613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.632976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e2a22-6b89-42fc-9d7c-c276853c807c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.644553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db745-777c-4f23-aa4e-e4f7f5436d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.646427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db745-777c-4f23-aa4e-e4f7f5436d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.647547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db745-777c-4f23-aa4e-e4f7f5436d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.648175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db745-777c-4f23-aa4e-e4f7f5436d16 admin admin] PATH_INFO: `/v3/projects/fc426f6694b144a5b926aa60918af4ef/users/43f8e9cedc5445da8fade24895ba4039/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.652469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db745-777c-4f23-aa4e-e4f7f5436d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc426f6694b144a5b926aa60918af4ef, user_id=43f8e9cedc5445da8fade24895ba4039, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.659585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db745-777c-4f23-aa4e-e4f7f5436d16 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.688437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 905/1813] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:31 2022] PUT /identity/v3/projects/fc426f6694b144a5b926aa60918af4ef/users/43f8e9cedc5445da8fade24895ba4039/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:31.703952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.705166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.710944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.745484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 909/1814] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:31.747647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.775974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18fdb8-f87d-448e-9150-f632b11337dd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.798360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] MFA Rules not processed for user `43f8e9cedc5445da8fade24895ba4039`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:31.799772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:31.875303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.876191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.877088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.877398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.878357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.880128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.904457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 910/1815] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:31.905811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.909409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:31.923800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750a1cc-00d4-454c-83eb-67464d1a93a2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.929606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.931321 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.931889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.932433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] PATH_INFO: `/v3/projects/ae9115f695e1452a921e843bc9f11f6f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.934278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9115f695e1452a921e843bc9f11f6f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.936943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.969245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 906/1816] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:31.970152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.994058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485506-447f-49b0-bff4-d15064f04f99 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.006711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.007513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.007885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.008237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.009676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.011500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.028754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 907/1817] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:32.028754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.031176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.087844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9115f695e1452a921e843bc9f11f6f', 'request_id': 'req-12222dde-2e3a-4079-8108-0a553564e159'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.140289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc1fe4-9fb1-4ebd-9e54-a6c3cb0c9bd3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.218192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.218847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.219123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.219389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.233818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9115f695e1452a921e843bc9f11f6f', 'request_id': 'req-12222dde-2e3a-4079-8108-0a553564e159'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.244864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9115f695e1452a921e843bc9f11f6f', 'request_id': 'req-12222dde-2e3a-4079-8108-0a553564e159'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.266708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] The token cache is being invalidate because project ae9115f695e1452a921e843bc9f11f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:32.267110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.274772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-12222dde-2e3a-4079-8108-0a553564e159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.274772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 911/1818] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:31 2022] DELETE /identity/v3/projects/ae9115f695e1452a921e843bc9f11f6f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:32.274772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c384-cf08-410b-a8e6-f429f4003d41 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.274772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c384-cf08-410b-a8e6-f429f4003d41 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.274772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c384-cf08-410b-a8e6-f429f4003d41 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.274772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 912/1819] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:32.275559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442c384-cf08-410b-a8e6-f429f4003d41 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.276172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0442c384-cf08-410b-a8e6-f429f4003d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.344186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.346027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.368984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 908/1820] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:32.370932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.373972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442c384-cf08-410b-a8e6-f429f4003d41 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.378202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:32.381849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025705a6-e3f3-4006-a662-093c78f781cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.383406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025705a6-e3f3-4006-a662-093c78f781cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.383406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025705a6-e3f3-4006-a662-093c78f781cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.388288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025705a6-e3f3-4006-a662-093c78f781cf admin admin] PATH_INFO: `/v3/projects/04bf9ac98f3841508480f2c7000e3eb8/users/151a1e8cb9a14d5da7758db0a3b6a290/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.389695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde1a8-05a2-413e-94a5-c96cc0762511 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.400709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.401731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.402079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.402427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] PATH_INFO: `/v3/users/1db0d4efc0384156ad8858cf1b466383` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.403965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db0d4efc0384156ad8858cf1b466383)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.406127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.408095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025705a6-e3f3-4006-a662-093c78f781cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bf9ac98f3841508480f2c7000e3eb8, user_id=151a1e8cb9a14d5da7758db0a3b6a290, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.411095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025705a6-e3f3-4006-a662-093c78f781cf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.523725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 913/1821] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:32 2022] PUT /identity/v3/projects/04bf9ac98f3841508480f2c7000e3eb8/users/151a1e8cb9a14d5da7758db0a3b6a290/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:32.525121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b942fa-fea1-477c-ad4b-3e77a57c424c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.525563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b942fa-fea1-477c-ad4b-3e77a57c424c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.525969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b942fa-fea1-477c-ad4b-3e77a57c424c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.551143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f4b942fa-fea1-477c-ad4b-3e77a57c424c None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:32.552410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f4b942fa-fea1-477c-ad4b-3e77a57c424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.640252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 914/1822] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:32.641630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.642485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.642814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.681337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] MFA Rules not processed for user `151a1e8cb9a14d5da7758db0a3b6a290`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:32.682926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.688185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db0d4efc0384156ad8858cf1b466383'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.771982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 915/1823] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:32.772988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.778695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.791699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03327d-c738-442c-9416-e23f6b885fa2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.797479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.799626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.799626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.799626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.827866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.827866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.828952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 916/1824] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:32.830411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.832825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.849664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db0d4efc0384156ad8858cf1b466383'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.851737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db0d4efc0384156ad8858cf1b466383'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.878836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db0d4efc0384156ad8858cf1b466383'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.879926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db0d4efc0384156ad8858cf1b466383'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.907015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 909/1825] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:32 2022] DELETE /identity/v3/users/1db0d4efc0384156ad8858cf1b466383 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:32.910441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.911409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.959413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f926d-9ac8-466b-a733-9306458af792 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.044047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:33.046915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823f220-5d30-4172-a1af-7085d507582f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.047280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.048078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.048412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.055286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.055286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.058855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.059562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.059845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.060120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.060867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.063050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.197344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.209409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.210761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 910/1826] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:32 2022] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:33.215198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.239038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 917/1827] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:33.367867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33847f28-37d4-4a7d-9ddd-a8e6291a3c13 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.374696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.375631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.376905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.377497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.378441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.381385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.487152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 911/1828] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:33 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:33.495012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.521687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d9a8-cfc6-4346-b754-9e68e17e572b service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.527401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.529454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.529691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.529977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.530791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.533103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.547980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 918/1829] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:33.552648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.568978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2176b3-3e23-4b37-89d0-8fdda89d100b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.574979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.576188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.576604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.576987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] PATH_INFO: `/v3/projects/586fec9bd24c4a27aadb2e2e13d10df9/users/0eef17814cd642e8a07e05b4caef5a00/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.598291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=586fec9bd24c4a27aadb2e2e13d10df9, user_id=0eef17814cd642e8a07e05b4caef5a00, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.601569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.647250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.649985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.677537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7d225-31ec-45ed-84b3-428832d699ca admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.689672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.690584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.690878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.691157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] PATH_INFO: `/v3/projects/15b5d8dd1e69404bac5e0ee235390bf1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.693995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b5d8dd1e69404bac5e0ee235390bf1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.697440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.705483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 912/1830] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:33 2022] PUT /identity/v3/projects/586fec9bd24c4a27aadb2e2e13d10df9/users/0eef17814cd642e8a07e05b4caef5a00/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:33.706424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.882901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c2da-8559-4de3-a643-190f11ada01c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.884261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b5d8dd1e69404bac5e0ee235390bf1', 'request_id': 'req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:33.949171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.950140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.950422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.950748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.951526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.953464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.969417 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 913/1831] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:33.976236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.995398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b31a-4674-4c8d-adec-ab6d92ff1c4b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.006509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2074a-b4bc-4865-982a-3a20b083e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.007694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2074a-b4bc-4865-982a-3a20b083e839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.008140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2074a-b4bc-4865-982a-3a20b083e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.009104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2074a-b4bc-4865-982a-3a20b083e839 admin admin] PATH_INFO: `/v3/projects/586fec9bd24c4a27aadb2e2e13d10df9/users/0eef17814cd642e8a07e05b4caef5a00/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.014093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2074a-b4bc-4865-982a-3a20b083e839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586fec9bd24c4a27aadb2e2e13d10df9, user_id=0eef17814cd642e8a07e05b4caef5a00, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.018513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2074a-b4bc-4865-982a-3a20b083e839 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.029133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b5d8dd1e69404bac5e0ee235390bf1', 'request_id': 'req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.031829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 914/1832] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:33 2022] PUT /identity/v3/projects/586fec9bd24c4a27aadb2e2e13d10df9/users/0eef17814cd642e8a07e05b4caef5a00/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:34.039039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b5d8dd1e69404bac5e0ee235390bf1', 'request_id': 'req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.043797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.044167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.044559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.072750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] The token cache is being invalidate because project 15b5d8dd1e69404bac5e0ee235390bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:34.072750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.077284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-79d4ff4f-bcc1-4af2-8f05-75ecd6fcf3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.084269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 919/1833] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:33 2022] DELETE /identity/v3/projects/15b5d8dd1e69404bac5e0ee235390bf1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:34.093589 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e707cc5-3e52-43c5-9c72-53b80b1fcade None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.094122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e707cc5-3e52-43c5-9c72-53b80b1fcade None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.094635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e707cc5-3e52-43c5-9c72-53b80b1fcade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.112759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] MFA Rules not processed for user `0eef17814cd642e8a07e05b4caef5a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:34.116414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.147852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7e707cc5-3e52-43c5-9c72-53b80b1fcade None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:34.150262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e707cc5-3e52-43c5-9c72-53b80b1fcade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.257332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 915/1834] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:34.274410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.276255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.291880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 920/1835] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:34.306759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.306759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.306759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.335209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:34.336395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.347911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 921/1836] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:34.351418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.358861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86341b22-c5c1-440f-9be7-11d4d2b6e2c9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.365107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.365796 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.366080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.366357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.367103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:34.368023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.370021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.371154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52ea2d-4dce-4b2a-b54b-40fe4623770e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.377460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.378433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.378956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.379421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.397104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 922/1837] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:34.401619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.412618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.414040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf7f4e-19f7-4558-8c14-9ea3c5dbccac admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.414903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.432811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.433594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.433823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.434113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.435636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.435866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 916/1838] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:34.439504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.601099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 923/1839] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/projects => generated 407 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:34.601832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.609043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19c898-2c05-43df-9677-84884954f38a service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.735108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.736406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.736791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.737096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.737813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.746050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.953993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 917/1840] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/users => generated 304 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:34.960235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.974911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535884ec-464e-44a3-9d3d-dce8768897db admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.981814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.982543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.982832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.985081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.993701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.996106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.022070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 924/1841] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:35.026244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.067336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acfddb-cf8e-49fd-991f-aadd4509b3dc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.074489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd036ca3-84e8-4007-9336-d1e2e13912aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.075263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd036ca3-84e8-4007-9336-d1e2e13912aa admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.076355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd036ca3-84e8-4007-9336-d1e2e13912aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.077109 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd036ca3-84e8-4007-9336-d1e2e13912aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.077517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd036ca3-84e8-4007-9336-d1e2e13912aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.080850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd036ca3-84e8-4007-9336-d1e2e13912aa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.094043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 918/1842] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:35.101019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.114653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a6bad-0355-499d-965e-c01ee6c3bd12 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.121982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.123328 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.123778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.124486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] PATH_INFO: `/v3/projects/42001778ef674b5c94b55bf5efbfde47/users/0007ede8665d406fa1e57f74d5742f13/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.144528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42001778ef674b5c94b55bf5efbfde47, user_id=0007ede8665d406fa1e57f74d5742f13, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.149023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.264854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 925/1843] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:35 2022] PUT /identity/v3/projects/42001778ef674b5c94b55bf5efbfde47/users/0007ede8665d406fa1e57f74d5742f13/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:35.286737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.287130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.287513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.369043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] MFA Rules not processed for user `0007ede8665d406fa1e57f74d5742f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:35.371240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.531189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 919/1844] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:35.537628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.621672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.628246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.708090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df3182-6198-4c14-aaee-c0a48165195c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.723848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.724982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.725564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.726020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.726982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.753384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.764023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:35.791807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d61aa-345b-464d-9576-d781f043cf7f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.800396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.801762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.802172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.802528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] PATH_INFO: `/v3/users/151a1e8cb9a14d5da7758db0a3b6a290` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.804256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151a1e8cb9a14d5da7758db0a3b6a290)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.808304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.963486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 926/1845] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/projects => generated 405 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:35.965098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.080198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151a1e8cb9a14d5da7758db0a3b6a290'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.095602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde60e71-881c-4248-8c76-d41c9d1b7150 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.116450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.116450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.116450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.116450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.116775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.122144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.200588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151a1e8cb9a14d5da7758db0a3b6a290'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.201299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151a1e8cb9a14d5da7758db0a3b6a290'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.226351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151a1e8cb9a14d5da7758db0a3b6a290'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.233943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2f894bb2-bd1b-4b9d-a09e-408bb697b1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151a1e8cb9a14d5da7758db0a3b6a290'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.242245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 927/1846] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/users => generated 309 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:36.243839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.253962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.262334 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 920/1847] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:35 2022] DELETE /identity/v3/users/151a1e8cb9a14d5da7758db0a3b6a290 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:36.269288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.270608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.271099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.283810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de6f48-24b3-47e1-9691-8876067bb112 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.293554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:36.295182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.431300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.432229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.432836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.433457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.435948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.439652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.461633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 928/1848] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:36.463950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.480512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f0ff-88f1-48a1-addf-902697e085d3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.493664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.496881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.496881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.496881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] PATH_INFO: `/v3/projects/f5cc4e52f1784446ace4d36fbad9451f/users/92ec1c4d548d4c2d83efa48857843283/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.523634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 921/1849] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:36.534686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cc4e52f1784446ace4d36fbad9451f, user_id=92ec1c4d548d4c2d83efa48857843283, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.535686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.537261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.537489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.685551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e532521-f7e8-4dee-9c69-3d4050f31354 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.691808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.692943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.693232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.693510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.719308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.720935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 929/1850] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:36 2022] PUT /identity/v3/projects/f5cc4e52f1784446ace4d36fbad9451f/users/92ec1c4d548d4c2d83efa48857843283/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:36.721427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.725079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.741609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 922/1851] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:36.749780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:36.870870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52901a78-f0ad-430c-a236-060f29c1222c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.879376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afbd2e-cc3c-41a2-b725-18523acb2fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.880478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbd2e-cc3c-41a2-b725-18523acb2fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.880917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbd2e-cc3c-41a2-b725-18523acb2fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.881336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbd2e-cc3c-41a2-b725-18523acb2fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.882425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afbd2e-cc3c-41a2-b725-18523acb2fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.884442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afbd2e-cc3c-41a2-b725-18523acb2fbe admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.899341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 930/1852] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:36.908227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.935751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c84a-c909-4bd8-a54e-f3bff4f6fcb2 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.943241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.944584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.945092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.945539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] PATH_INFO: `/v3/projects/f5cc4e52f1784446ace4d36fbad9451f/users/92ec1c4d548d4c2d83efa48857843283/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.948434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cc4e52f1784446ace4d36fbad9451f, user_id=92ec1c4d548d4c2d83efa48857843283, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.953484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.976306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 923/1853] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:36 2022] PUT /identity/v3/projects/f5cc4e52f1784446ace4d36fbad9451f/users/92ec1c4d548d4c2d83efa48857843283/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:36.987624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.987916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.988205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.019609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] MFA Rules not processed for user `92ec1c4d548d4c2d83efa48857843283`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:37.021039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:37.150330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 931/1854] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:37.169922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.175352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:37.287204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bff7d-48e2-4675-acc8-6c7159dda105 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.292091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.293155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.293680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.294195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.313933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.319857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.350187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 924/1855] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:38.004385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.006825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.053649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.085712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff32337-8b5f-4605-9a87-cbe68cd3984b service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.100499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.113986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.114705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.116092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.127282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.151908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979522dc-1c74-4d1c-acfa-66fe2545ae05 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.157580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.165191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.165701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.166098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] PATH_INFO: `/v3/users/0811768e6e4747e19531f9c215e18847` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.178247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0811768e6e4747e19531f9c215e18847)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.183083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.331592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.333506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.349734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 925/1856] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:38.387452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.395008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.441859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935c717-da73-4d54-af27-8f214c9632ac service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.457621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.459244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.461464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.461813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] PATH_INFO: `/v3/projects/04bf9ac98f3841508480f2c7000e3eb8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.466039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bf9ac98f3841508480f2c7000e3eb8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.471659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.628936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0811768e6e4747e19531f9c215e18847'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.746857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bf9ac98f3841508480f2c7000e3eb8', 'request_id': 'req-6088d9ec-d361-4f31-9318-3961114b8198'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.757476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0811768e6e4747e19531f9c215e18847'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.758366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0811768e6e4747e19531f9c215e18847'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.759237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0811768e6e4747e19531f9c215e18847'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.761964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bf9ac98f3841508480f2c7000e3eb8', 'request_id': 'req-6088d9ec-d361-4f31-9318-3961114b8198'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.775632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bf9ac98f3841508480f2c7000e3eb8', 'request_id': 'req-6088d9ec-d361-4f31-9318-3961114b8198'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.794493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d2edc1fd-1ea0-47ad-a72b-7353d86d0ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0811768e6e4747e19531f9c215e18847'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.818409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 932/1857] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:38 2022] DELETE /identity/v3/users/0811768e6e4747e19531f9c215e18847 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:38.832861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.833518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.834048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.866142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:38.868662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.955548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] The token cache is being invalidate because project 04bf9ac98f3841508480f2c7000e3eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:38.955908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.956890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.958942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 926/1858] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:38 2022] DELETE /identity/v3/projects/04bf9ac98f3841508480f2c7000e3eb8 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:38.963649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.965246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.986360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 933/1859] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:39.029306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:39.031573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:39.064794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:39.065054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d9ec-d361-4f31-9318-3961114b8198 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:39.071906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:39.073096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.073663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.074455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] PATH_INFO: `/v3/users/0eef17814cd642e8a07e05b4caef5a00` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.076511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eef17814cd642e8a07e05b4caef5a00)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:39.079750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:39.151023 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b257f2-2fae-4e1f-b0a3-008a6c3b4223 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:39.155941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:39.156743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.157729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.158011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.168552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:39.170138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:39.181969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 934/1860] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:39.364018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eef17814cd642e8a07e05b4caef5a00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.490990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eef17814cd642e8a07e05b4caef5a00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.492706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eef17814cd642e8a07e05b4caef5a00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.546999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eef17814cd642e8a07e05b4caef5a00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.547438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eef17814cd642e8a07e05b4caef5a00'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.609912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 927/1861] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:38 2022] DELETE /identity/v3/users/0eef17814cd642e8a07e05b4caef5a00 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:40.075669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.077246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:40.093152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbacad-8f2a-4339-a676-3febe930750b service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.230079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.231769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.232161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.232649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] PATH_INFO: `/v3/projects/28f47dab199d42b8a70987018743b2ab` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.234372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f47dab199d42b8a70987018743b2ab)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.238389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.243994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:40.442395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f47dab199d42b8a70987018743b2ab', 'request_id': 'req-be15e88d-529a-47e0-98d0-a328948b3457'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:40.531959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.534850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:40.572473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6f7a1-a8aa-49ef-a760-33718d687476 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.577656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f47dab199d42b8a70987018743b2ab', 'request_id': 'req-be15e88d-529a-47e0-98d0-a328948b3457'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:40.592239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f47dab199d42b8a70987018743b2ab', 'request_id': 'req-be15e88d-529a-47e0-98d0-a328948b3457'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:40.607999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] The token cache is being invalidate because project 28f47dab199d42b8a70987018743b2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:40.608686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:40.609670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:40.613791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 935/1862] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:40 2022] DELETE /identity/v3/projects/28f47dab199d42b8a70987018743b2ab => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:40.619671 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.622744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:40.739229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.739229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.739229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.739229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] PATH_INFO: `/v3/projects/586fec9bd24c4a27aadb2e2e13d10df9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.739664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586fec9bd24c4a27aadb2e2e13d10df9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.741255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.759075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15e88d-529a-47e0-98d0-a328948b3457 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.768804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.769758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.770050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.770331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] PATH_INFO: `/v3/users/43f8e9cedc5445da8fade24895ba4039` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.772741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f8e9cedc5445da8fade24895ba4039)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.775823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.080936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f8e9cedc5445da8fade24895ba4039'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.094205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586fec9bd24c4a27aadb2e2e13d10df9', 'request_id': 'req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.101333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586fec9bd24c4a27aadb2e2e13d10df9', 'request_id': 'req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.109365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586fec9bd24c4a27aadb2e2e13d10df9', 'request_id': 'req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.337181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f8e9cedc5445da8fade24895ba4039'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.337815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f8e9cedc5445da8fade24895ba4039'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.338502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f8e9cedc5445da8fade24895ba4039'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.370848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-f04f6188-891c-4946-9a20-5792e458ab9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f8e9cedc5445da8fade24895ba4039'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.397742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 936/1863] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:40 2022] DELETE /identity/v3/users/43f8e9cedc5445da8fade24895ba4039 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:41.523834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] The token cache is being invalidate because project 586fec9bd24c4a27aadb2e2e13d10df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:41.524347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.526812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d7a1d0e8-eb52-4be8-8971-e0ed78e36216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.537150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 928/1864] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:40 2022] DELETE /identity/v3/projects/586fec9bd24c4a27aadb2e2e13d10df9 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:41.544395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.544892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.545890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.602096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:41.605136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.751138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 937/1865] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:41.759039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.759375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.759737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.786878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:41.789509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.803956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 929/1866] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:41.808562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.820761 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67911ee-e7c6-4e35-b53f-efda99466490 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.831164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:41.832238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.833603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.834062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.835394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:41.836040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:41.840776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.855103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 938/1867] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:41.861254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.877230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a75f3-bb05-463b-8ead-651ac864f2fc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.883244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:41.884654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.885466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.886172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.887410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:41.890126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.008885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 930/1868] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:42.013221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.024649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ace3-d837-4fcd-acc8-9c4e41ea678e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.072514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.075567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.121372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.123608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.124051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.124356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.126296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.130543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.242735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 939/1869] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:42.247196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.250276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb83c-00bc-480b-85a4-d213f7f55ded admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.261036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.261252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3260ad-6141-4886-9111-a5355908b2a6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.262567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.262996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.264722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] PATH_INFO: `/v3/projects/fc426f6694b144a5b926aa60918af4ef` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.269006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc426f6694b144a5b926aa60918af4ef)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.270055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.270977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.271304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.272834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.272834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.273049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.274994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.289837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 940/1870] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:42.294054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.312637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dd144-92a3-44bb-ba61-673eaabf9a9d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.317715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.318398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.318682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.318962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.319692 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.321362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.340317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 941/1871] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:42.345442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.356240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119dbbf-ae50-43b1-8b9e-171f0e3784d7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.362339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87bc6-16ca-46fa-89ec-7bb0dc153376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.363367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87bc6-16ca-46fa-89ec-7bb0dc153376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.363662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87bc6-16ca-46fa-89ec-7bb0dc153376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.363931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87bc6-16ca-46fa-89ec-7bb0dc153376 admin admin] PATH_INFO: `/v3/projects/4e365c97e4fe4ea489d096ba7e5fd22e/users/46751a87948c498a867f47e880e7f7b7/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.387846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87bc6-16ca-46fa-89ec-7bb0dc153376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e365c97e4fe4ea489d096ba7e5fd22e, user_id=46751a87948c498a867f47e880e7f7b7, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.389573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87bc6-16ca-46fa-89ec-7bb0dc153376 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.452108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:42.498089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 942/1872] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:42 2022] PUT /identity/v3/projects/4e365c97e4fe4ea489d096ba7e5fd22e/users/46751a87948c498a867f47e880e7f7b7/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:42.525449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.525984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.526423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.534323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc426f6694b144a5b926aa60918af4ef', 'request_id': 'req-240fb24f-be67-40a3-bf59-824757a18a1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.548113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc426f6694b144a5b926aa60918af4ef', 'request_id': 'req-240fb24f-be67-40a3-bf59-824757a18a1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.558425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc426f6694b144a5b926aa60918af4ef', 'request_id': 'req-240fb24f-be67-40a3-bf59-824757a18a1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.565046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] MFA Rules not processed for user `46751a87948c498a867f47e880e7f7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:42.566281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.648148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 943/1873] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:42.660510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.662453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.689680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] The token cache is being invalidate because project fc426f6694b144a5b926aa60918af4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:42.690123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.691486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-240fb24f-be67-40a3-bf59-824757a18a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.693712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 931/1874] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:42 2022] DELETE /identity/v3/projects/fc426f6694b144a5b926aa60918af4ef => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:42.699073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd69f-e9a3-4aec-aa99-1dfd401035ea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.700006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd69f-e9a3-4aec-aa99-1dfd401035ea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.700294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd69f-e9a3-4aec-aa99-1dfd401035ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.726169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cc0fd69f-e9a3-4aec-aa99-1dfd401035ea None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:42.727898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cc0fd69f-e9a3-4aec-aa99-1dfd401035ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.753750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ac969-cff6-402e-a783-ac68085dd561 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.771221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.772111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.772647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.772952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.775736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.809919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.809919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.820495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 932/1875] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:42.822280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.822646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.822995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.823473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 944/1876] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:42.846974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:42.850157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.859717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 933/1877] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:42.865523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.883475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0739-cc7f-494d-bb2a-dca3ca8743b3 service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.889107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.889792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.890078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.890353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.891646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:42.892007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.893861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.908022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 945/1878] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:42.912989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.929352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c57e2-6f9f-4b6a-80d5-81e3980a8939 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.934961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.935407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.935688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.935965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.936700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.938719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.150564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 934/1879] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:43.155421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.189438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109be4c-2d91-4659-a072-0f925fe259e3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.338492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.339219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.339595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.339874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.340653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.343234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.460552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 946/1880] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:43 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:43.466279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.478088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427dafc-ffa3-4133-b45e-d38a3a4b8a8a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.484569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.486718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.487111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.487527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.488441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.493509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.504130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 935/1881] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:43.510080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.526562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ab81d-68ab-473b-82ac-f26d5f00c1c1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.538052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088802-a586-4261-ba25-5708ec6b82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.538952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088802-a586-4261-ba25-5708ec6b82f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.539241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088802-a586-4261-ba25-5708ec6b82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.539522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088802-a586-4261-ba25-5708ec6b82f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.540259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088802-a586-4261-ba25-5708ec6b82f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.542515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088802-a586-4261-ba25-5708ec6b82f5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.560399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 947/1882] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:43.565118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.576468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149f86a-007a-4095-ba07-7a205b369218 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.581638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.582549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.582836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.583116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] PATH_INFO: `/v3/projects/e0840ca1652c481fb7fbbd15c84c27d3/users/b0238a936d384c8ba016b0bc7e686ce1/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.599834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0840ca1652c481fb7fbbd15c84c27d3, user_id=b0238a936d384c8ba016b0bc7e686ce1, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.602596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.683766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 936/1883] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:43 2022] PUT /identity/v3/projects/e0840ca1652c481fb7fbbd15c84c27d3/users/b0238a936d384c8ba016b0bc7e686ce1/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:43.699951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.700237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.700579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.736912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] MFA Rules not processed for user `b0238a936d384c8ba016b0bc7e686ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:43.738290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:43.815474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 948/1884] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:43.820479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.911834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c922e9-e6e6-4d50-ab46-9812f5fb811b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.918701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.919474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.919780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.920059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.921017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.923511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.053921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 937/1885] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:43 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:44.061122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.073780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1251497-ac22-4f94-9e08-8547a207f3f2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.094864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:44.148286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.149491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.149991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.150475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.152199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.155435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.331833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 949/1886] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:44.335944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.348721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17d82-6f8f-42dc-9955-a69ec827a152 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.356157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.356879 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.357165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.357444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.358248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.359890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.374063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 938/1887] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:44.378593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.390837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17280-86d8-467c-a090-a2b01c2e9105 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.396817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.397879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.398214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.398534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] PATH_INFO: `/v3/projects/c6ddfae596ee4f93adb1eb34820f218c/users/f3c2838b95354f4eade6ee5649b5d8fc/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.416949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ddfae596ee4f93adb1eb34820f218c, user_id=f3c2838b95354f4eade6ee5649b5d8fc, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.421389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.507772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 950/1888] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:44 2022] PUT /identity/v3/projects/c6ddfae596ee4f93adb1eb34820f218c/users/f3c2838b95354f4eade6ee5649b5d8fc/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:44.511583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.523477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9d1fa-21ec-4c21-ab31-facbfaae3cf7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.606552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153d42-e42d-48c2-a000-982f695d1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.607305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153d42-e42d-48c2-a000-982f695d1b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.607492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153d42-e42d-48c2-a000-982f695d1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.607745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153d42-e42d-48c2-a000-982f695d1b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.608564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153d42-e42d-48c2-a000-982f695d1b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.610593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153d42-e42d-48c2-a000-982f695d1b0b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.622188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 939/1889] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:44.627040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.643710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db34bf-79e4-4525-bd25-97b0186a9a9b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.648947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.650423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.651016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.651511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] PATH_INFO: `/v3/projects/c6ddfae596ee4f93adb1eb34820f218c/users/f3c2838b95354f4eade6ee5649b5d8fc/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.653956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ddfae596ee4f93adb1eb34820f218c, user_id=f3c2838b95354f4eade6ee5649b5d8fc, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.656886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.669168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 951/1890] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:44 2022] PUT /identity/v3/projects/c6ddfae596ee4f93adb1eb34820f218c/users/f3c2838b95354f4eade6ee5649b5d8fc/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:44.682491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.683234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.684739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.749996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] MFA Rules not processed for user `f3c2838b95354f4eade6ee5649b5d8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.751900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.859066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 940/1891] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:44.877216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.879806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.953593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9510dd0-5ff3-4630-b37b-1ab7ce21fe43 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.957490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3162da-b13f-4528-ac8d-9a37b11d0a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.958176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3162da-b13f-4528-ac8d-9a37b11d0a32 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.958459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3162da-b13f-4528-ac8d-9a37b11d0a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.958739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3162da-b13f-4528-ac8d-9a37b11d0a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.971584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3162da-b13f-4528-ac8d-9a37b11d0a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.971962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3162da-b13f-4528-ac8d-9a37b11d0a32 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.983402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 952/1892] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:45.435654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.438653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:45.569066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bbe8-f6ba-477d-9f74-4969bb801c09 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.575402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.576724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.577090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.577609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] PATH_INFO: `/v3/users/6d075037947a44fe80a62433b87cac65` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.579584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d075037947a44fe80a62433b87cac65)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.582364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.795045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d075037947a44fe80a62433b87cac65'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.049660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d075037947a44fe80a62433b87cac65'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.051113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d075037947a44fe80a62433b87cac65'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.074108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d075037947a44fe80a62433b87cac65'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.075267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d075037947a44fe80a62433b87cac65'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.103441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 941/1893] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:45 2022] DELETE /identity/v3/users/6d075037947a44fe80a62433b87cac65 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:46.108366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.108930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.109270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.152517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:46.155021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:46.188766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:46.279085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 953/1894] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:46.310167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:46.313483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:46.398987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e974a8-959c-4796-9157-d2accd041ad3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:46.402918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:46.403632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.403896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.404171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.416269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:46.421409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:46.434681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 942/1895] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:46.629553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:46.631152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:46.735483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8cc5-f54e-4e00-8875-851dab160f33 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:46.742947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2838b95354f4eade6ee5649b5d8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6ddfae596ee4f93adb1eb34820f218c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:46.743902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.744217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.744568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.745510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:46.745812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:46.747683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:46.764734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 954/1896] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:46.769574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:46.780690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee38f-5193-438d-8f18-ba5e59be898a service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:46.786319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2838b95354f4eade6ee5649b5d8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6ddfae596ee4f93adb1eb34820f218c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:46.787300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.787579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.787860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.788611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:46.790741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:46.931150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 943/1897] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:46 2022] POST /identity/v3/projects => generated 354 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:46.935630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:46.953032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8febb-20af-4290-adda-aef34afe156f tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.035752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.038250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:47.106165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2838b95354f4eade6ee5649b5d8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6ddfae596ee4f93adb1eb34820f218c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.107194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.107636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.112583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.117299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:47.117938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.121769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:47.144623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 955/1898] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:47.173213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65b978-4fdc-42de-9139-dbaf0a4d1b4a tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.180261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.184470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.185020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.185416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] PATH_INFO: `/v3/projects/fe6742bb00e44ac187e009d91d755a79` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.187133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6742bb00e44ac187e009d91d755a79)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.189392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:47.210581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.223102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629869-0ebd-4e75-a229-9f459ece3db6 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.241399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2838b95354f4eade6ee5649b5d8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6ddfae596ee4f93adb1eb34820f218c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.243524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.244423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.249111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] PATH_INFO: `/v3/projects/9cc7c94b615642c99466deeeee7e9b7a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.253907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9cc7c94b615642c99466deeeee7e9b7a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.253907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:47.346960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6742bb00e44ac187e009d91d755a79', 'request_id': 'req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.356431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6742bb00e44ac187e009d91d755a79', 'request_id': 'req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.364845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6742bb00e44ac187e009d91d755a79', 'request_id': 'req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.486008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc7c94b615642c99466deeeee7e9b7a', 'request_id': 'req-72722fc7-a239-4e4e-9ddc-33928e202901'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.492704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] The token cache is being invalidate because project fe6742bb00e44ac187e009d91d755a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:47.492704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.492704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.497090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 944/1899] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/projects/fe6742bb00e44ac187e009d91d755a79 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:47.500959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.504371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:47.593990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc7c94b615642c99466deeeee7e9b7a', 'request_id': 'req-72722fc7-a239-4e4e-9ddc-33928e202901'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.615335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc7c94b615642c99466deeeee7e9b7a', 'request_id': 'req-72722fc7-a239-4e4e-9ddc-33928e202901'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.630418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fa79-d5ee-4c38-bb6e-d8bcd2afc761 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.648648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] The token cache is being invalidate because project 9cc7c94b615642c99466deeeee7e9b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:47.649187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.659409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.664478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 956/1900] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/projects/9cc7c94b615642c99466deeeee7e9b7a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:47.740200 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.741177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.741473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.741739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] PATH_INFO: `/v3/users/f759007cfc504ec797e6bd5b6bf161c7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.743125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f759007cfc504ec797e6bd5b6bf161c7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.745480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:47.869585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.871368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:47.888258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72722fc7-a239-4e4e-9ddc-33928e202901 tempest-VolumeQuotaClassesTest-623058067 tempest-VolumeQuotaClassesTest-623058067-project-admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.894255 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.895167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.895456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.895725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] PATH_INFO: `/v3/users/0007ede8665d406fa1e57f74d5742f13` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.897323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0007ede8665d406fa1e57f74d5742f13)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.899390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.178785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f759007cfc504ec797e6bd5b6bf161c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.292930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f759007cfc504ec797e6bd5b6bf161c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.292930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f759007cfc504ec797e6bd5b6bf161c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.314015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0007ede8665d406fa1e57f74d5742f13'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.328795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f759007cfc504ec797e6bd5b6bf161c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.329596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7107b038-581d-4c35-b284-0957f77784c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f759007cfc504ec797e6bd5b6bf161c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.345848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 945/1901] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/users/f759007cfc504ec797e6bd5b6bf161c7 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:48.523842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0007ede8665d406fa1e57f74d5742f13'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.525051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0007ede8665d406fa1e57f74d5742f13'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.526769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0007ede8665d406fa1e57f74d5742f13'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.562317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0007ede8665d406fa1e57f74d5742f13'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.584993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 957/1902] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/users/0007ede8665d406fa1e57f74d5742f13 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:48.591900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.593026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.593321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.626598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:48.628913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.746685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 946/1903] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:48.761612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.763286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.876612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.878139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.880726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a89af-4792-4114-af87-2239ec376c64 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.898962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.899324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4574e-4c32-4793-bf94-4701d741c84f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.899629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.899916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.900196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.907335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.908729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.909726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.910436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] PATH_INFO: `/v3/users/b0238a936d384c8ba016b0bc7e686ce1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.915096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0238a936d384c8ba016b0bc7e686ce1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.915513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.918849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.921276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.939617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 958/1904] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:49.149888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.151434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.168476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d6d4-2fbf-4256-b885-dce3fff6ac60 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.174114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.175076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.175572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.175861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] PATH_INFO: `/v3/projects/ce40c856a6194d0b8fcfb1085a5da0fb` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.179284 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce40c856a6194d0b8fcfb1085a5da0fb)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.181431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.258321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0238a936d384c8ba016b0bc7e686ce1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.266822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:49.358423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0238a936d384c8ba016b0bc7e686ce1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.360492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0238a936d384c8ba016b0bc7e686ce1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.360881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce40c856a6194d0b8fcfb1085a5da0fb', 'request_id': 'req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.399802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0238a936d384c8ba016b0bc7e686ce1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.403864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-22200656-8e7d-4e32-b84e-bfd64a652a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0238a936d384c8ba016b0bc7e686ce1'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.441485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 947/1905] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:48 2022] DELETE /identity/v3/users/b0238a936d384c8ba016b0bc7e686ce1 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:49.454912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:49.460520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.462024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.462720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.479949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce40c856a6194d0b8fcfb1085a5da0fb', 'request_id': 'req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.491724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.493142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.499372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce40c856a6194d0b8fcfb1085a5da0fb', 'request_id': 'req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.534582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] The token cache is being invalidate because project ce40c856a6194d0b8fcfb1085a5da0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:49.534582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.534582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e2af42d2-b3ac-4efa-bd78-a994bcaf768f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.535622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 959/1906] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:49 2022] DELETE /identity/v3/projects/ce40c856a6194d0b8fcfb1085a5da0fb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:49.542528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704c3d-328e-4ccd-a70c-ac69e0a62f63 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.542904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704c3d-328e-4ccd-a70c-ac69e0a62f63 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.543261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704c3d-328e-4ccd-a70c-ac69e0a62f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.577041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-22704c3d-328e-4ccd-a70c-ac69e0a62f63 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.579408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22704c3d-328e-4ccd-a70c-ac69e0a62f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.604137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 948/1907] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:49.615824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.617833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.705417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 960/1908] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:49.719810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6382fa-7f6b-4e0d-9d12-18b76308cbff None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.720461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.721107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.721690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.724358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.725159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.729472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.729472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.740515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.742140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.767093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 949/1909] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:49.769835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.772923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.777345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.780357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.801152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 961/1910] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:49.807448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.842018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2acd8-3e42-42c5-8015-470ffd5de508 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.847293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a5ff-cd7e-4058-a071-686eccd87430 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.857222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.867164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.867164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.867164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.867164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:49.872038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.873751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.874026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.878162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.879261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.881413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] PATH_INFO: `/v3/projects/42001778ef674b5c94b55bf5efbfde47` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.886311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=42001778ef674b5c94b55bf5efbfde47)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.896835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.904804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 962/1911] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:49.911700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.939568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c664a6-3e36-4344-836f-ad6040f64106 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.962842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.963713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.964026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.964314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.965032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.967098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.107015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 963/1912] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:50.117810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.123130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42001778ef674b5c94b55bf5efbfde47', 'request_id': 'req-3849fd9f-663c-47a9-b0f5-e0073c146edd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.132966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42001778ef674b5c94b55bf5efbfde47', 'request_id': 'req-3849fd9f-663c-47a9-b0f5-e0073c146edd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.142012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42001778ef674b5c94b55bf5efbfde47', 'request_id': 'req-3849fd9f-663c-47a9-b0f5-e0073c146edd'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.220554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fadb4-c6ec-425f-8004-e8a770f83b61 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.224361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] The token cache is being invalidate because project 42001778ef674b5c94b55bf5efbfde47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:50.224666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.225405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.227325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 950/1913] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:49 2022] DELETE /identity/v3/projects/42001778ef674b5c94b55bf5efbfde47 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:50.231508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.233369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.237524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.239886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.240264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.240777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.245024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.245024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.324849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849fd9f-663c-47a9-b0f5-e0073c146edd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.331307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.332286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.332605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.332880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] PATH_INFO: `/v3/users/92ec1c4d548d4c2d83efa48857843283` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.334413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ec1c4d548d4c2d83efa48857843283)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.336357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.362258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 964/1914] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:50.368041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.371934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.387504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f542-d327-49ac-9901-94cb92ff1075 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.404751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.414214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.414750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.415337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.417074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.420544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.437424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 965/1915] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:50.441567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.454483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609dab6-964c-4f23-9433-301445733097 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.460961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.461660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.461942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.462223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.463011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.464815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.482354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 966/1916] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:50.486741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.504074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fd726-5d45-4148-a43d-90c7d9581faa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.511941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.512901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.513186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.513466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] PATH_INFO: `/v3/projects/8404dc88ee6f4dc8a6a1ddc4d5367c88/users/c716345724824c5985547cc09dee3a8d/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.534413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8404dc88ee6f4dc8a6a1ddc4d5367c88, user_id=c716345724824c5985547cc09dee3a8d, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.540222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.650809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 967/1917] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:50 2022] PUT /identity/v3/projects/8404dc88ee6f4dc8a6a1ddc4d5367c88/users/c716345724824c5985547cc09dee3a8d/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:50.652875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.654275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ec1c4d548d4c2d83efa48857843283'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.655786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.763263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709d255-096c-4f10-bdc8-fed81f3f054c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.769538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.770446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.770724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.771006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] PATH_INFO: `/v3/projects/e0840ca1652c481fb7fbbd15c84c27d3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.772311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0840ca1652c481fb7fbbd15c84c27d3)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.774344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.794546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ec1c4d548d4c2d83efa48857843283'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.795813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ec1c4d548d4c2d83efa48857843283'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.825169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ec1c4d548d4c2d83efa48857843283'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.825987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1da613d4-a834-438b-b810-89272e6b9d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ec1c4d548d4c2d83efa48857843283'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.845544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 951/1918] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:50 2022] DELETE /identity/v3/users/92ec1c4d548d4c2d83efa48857843283 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:50.848724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.849242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.849964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.886458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] MFA Rules not processed for user `c716345724824c5985547cc09dee3a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:50.887766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.946098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0840ca1652c481fb7fbbd15c84c27d3', 'request_id': 'req-c3f25d2b-623f-480b-8095-db9a71999f3f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.967592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 952/1919] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:50.972397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.973851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.043769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0840ca1652c481fb7fbbd15c84c27d3', 'request_id': 'req-c3f25d2b-623f-480b-8095-db9a71999f3f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.054269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f6213-959f-4abb-bb58-a338a75ace14 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.057516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0840ca1652c481fb7fbbd15c84c27d3', 'request_id': 'req-c3f25d2b-623f-480b-8095-db9a71999f3f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.079944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] The token cache is being invalidate because project e0840ca1652c481fb7fbbd15c84c27d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:51.080259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.081653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.089127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 968/1920] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:50 2022] DELETE /identity/v3/projects/e0840ca1652c481fb7fbbd15c84c27d3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:51.098717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.116414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.173955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.175750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.176232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.176828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.178105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.182010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.249100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25d2b-623f-480b-8095-db9a71999f3f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.258939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.261579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.262049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.262520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] PATH_INFO: `/v3/users/f3c2838b95354f4eade6ee5649b5d8fc` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.264793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c2838b95354f4eade6ee5649b5d8fc)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.268521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.322304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 953/1921] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/projects => generated 385 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:51.326325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.328132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.357878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.412261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f721-06ad-4a38-b719-5a2c49048080 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.418920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.420245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.420789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.421078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.422558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.424858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.579716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c2838b95354f4eade6ee5649b5d8fc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.602152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 954/1922] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:51.603559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.605834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.620496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d0634-91a9-4804-bc3b-4852f8c362a9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.625689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.626584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.626865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.627179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] PATH_INFO: `/v3/projects/f5cc4e52f1784446ace4d36fbad9451f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.628453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cc4e52f1784446ace4d36fbad9451f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.630443 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.673820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c2838b95354f4eade6ee5649b5d8fc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.675012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c2838b95354f4eade6ee5649b5d8fc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.675707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c2838b95354f4eade6ee5649b5d8fc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.691845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c2838b95354f4eade6ee5649b5d8fc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.719949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 969/1923] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:51 2022] DELETE /identity/v3/users/f3c2838b95354f4eade6ee5649b5d8fc => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:51.721740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.724646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.789175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cc4e52f1784446ace4d36fbad9451f', 'request_id': 'req-ae2dcc16-1609-4b29-afdc-2358532cfa33'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.796059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cc4e52f1784446ace4d36fbad9451f', 'request_id': 'req-ae2dcc16-1609-4b29-afdc-2358532cfa33'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.806344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cc4e52f1784446ace4d36fbad9451f', 'request_id': 'req-ae2dcc16-1609-4b29-afdc-2358532cfa33'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.845670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61995c-53b4-42dd-82a5-86d61348dd7a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.920286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.921199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.921327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.921762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.922469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.924021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.938454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 970/1924] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:51.945575 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.947067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] The token cache is being invalidate because project f5cc4e52f1784446ace4d36fbad9451f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:51.947752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.949014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ae2dcc16-1609-4b29-afdc-2358532cfa33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.957384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280b49c-b48b-40b1-add7-998e0879d528 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.958607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 955/1925] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:51 2022] DELETE /identity/v3/projects/f5cc4e52f1784446ace4d36fbad9451f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:51.961344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5678-2da2-435b-91f2-9a9d4dc1c784 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.962210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5678-2da2-435b-91f2-9a9d4dc1c784 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.962739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5678-2da2-435b-91f2-9a9d4dc1c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.963264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.964088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.964464 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.964815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.966667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.969319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.981563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 971/1926] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:51.986029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.988879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.004254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250e0a-a283-454c-996a-6df91b7c8012 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.006266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8b7f5678-2da2-435b-91f2-9a9d4dc1c784 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:52.008225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8b7f5678-2da2-435b-91f2-9a9d4dc1c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.010765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d8c9-89fa-4a1a-9fb7-f4eb56639668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.011971 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d8c9-89fa-4a1a-9fb7-f4eb56639668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.012493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d8c9-89fa-4a1a-9fb7-f4eb56639668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.012882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d8c9-89fa-4a1a-9fb7-f4eb56639668 admin admin] PATH_INFO: `/v3/projects/0dad9cbc79f64a37a4cd8610a3a97882/users/9f194c3356794731b1fca596d877fdba/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.019645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 956/1927] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:52.030197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.030489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.030770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.050649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d8c9-89fa-4a1a-9fb7-f4eb56639668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dad9cbc79f64a37a4cd8610a3a97882, user_id=9f194c3356794731b1fca596d877fdba, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.054892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d8c9-89fa-4a1a-9fb7-f4eb56639668 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.071332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:52.072826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.083346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 957/1928] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:52.087857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.098139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b39a69-1634-4466-b442-5809aee92a9d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.103300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.104085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.104469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.104780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.105711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:52.106094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.108011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.133284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 958/1929] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:52.135423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.146620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 972/1930] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:51 2022] PUT /identity/v3/projects/0dad9cbc79f64a37a4cd8610a3a97882/users/9f194c3356794731b1fca596d877fdba/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:52.157316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.157502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.157656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.161355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453889e-1e7d-45e2-a2c5-066ff5f73a0f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.188706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] MFA Rules not processed for user `9f194c3356794731b1fca596d877fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:52.190317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.271699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.273077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.273573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.274201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.275522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.279459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.310390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 973/1931] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:52.316392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.330798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c086c72-609a-4d2e-8843-abb49a109001 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.343512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.343512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.343512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.343512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.344016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.344016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.412869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 959/1932] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.414121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.415843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.481008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 974/1933] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:52.485673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.504431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb709b-38fb-4db4-916f-ca5e653a1485 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.592076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:52.606155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5bd72-1439-4143-a881-435466c2baf8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.625508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.626792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.627690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.627868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.628024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.628238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] PATH_INFO: `/v3/projects/c6ddfae596ee4f93adb1eb34820f218c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.628749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.629474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.630141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ddfae596ee4f93adb1eb34820f218c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.631379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.633035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.641743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.768821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 975/1934] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.770247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.789789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89229d6e-40a0-4fc8-a828-b94a2ae1e76c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.799370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.800683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.801182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.801570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.814967 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.823070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.831015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ddfae596ee4f93adb1eb34820f218c', 'request_id': 'req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.841321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ddfae596ee4f93adb1eb34820f218c', 'request_id': 'req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.856314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ddfae596ee4f93adb1eb34820f218c', 'request_id': 'req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.970213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 976/1935] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.970913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.988580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397753-44d6-4d0b-ade3-ad00e765ef4b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.997861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] The token cache is being invalidate because project c6ddfae596ee4f93adb1eb34820f218c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:52.998375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.999705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:53.002800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 960/1936] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:37:52 2022] DELETE /identity/v3/projects/c6ddfae596ee4f93adb1eb34820f218c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:53.004423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.007025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.060948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d0f1c-57eb-4f8a-98d7-803eb8bac082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.061829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0f1c-57eb-4f8a-98d7-803eb8bac082 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.062214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0f1c-57eb-4f8a-98d7-803eb8bac082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.062581 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0f1c-57eb-4f8a-98d7-803eb8bac082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.063500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d0f1c-57eb-4f8a-98d7-803eb8bac082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.065323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d0f1c-57eb-4f8a-98d7-803eb8bac082 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.079134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 977/1937] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:53.080778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.081071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.081364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.101497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:53.103059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.112568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 978/1938] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:53.113351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.114773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.130100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6cdb-b17a-4a25-b0f2-2e2a576a0932 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.130497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380ca90-6799-468b-85f8-3711f0ec2e10 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.135740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026973-6d16-439a-868c-e1739d40834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.136569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026973-6d16-439a-868c-e1739d40834c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.136860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026973-6d16-439a-868c-e1739d40834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.137141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026973-6d16-439a-868c-e1739d40834c admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.137907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026973-6d16-439a-868c-e1739d40834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.138909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.139576 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026973-6d16-439a-868c-e1739d40834c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.139745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.140021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.141117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.142089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.144405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.150198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:53.155439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 979/1939] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:53.159373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.165364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.165364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.171264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 961/1940] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:53.171264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.192696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c49220-cef3-4228-9e30-db0444b787c0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.199299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:53.201116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.201656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.202267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.204861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.204861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] PATH_INFO: `/v3/projects/b578c7a6ec844b5683da638eda094a78/users/7a9546cd3ae1447f91adbc678e5936d7/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.227456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 980/1941] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:53.227456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.243798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b578c7a6ec844b5683da638eda094a78, user_id=7a9546cd3ae1447f91adbc678e5936d7, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.245097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66025e-bf7a-4d5f-bed3-d81f2387992d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.248973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.255918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb1fd-5f66-42a0-aeaf-fb1838e795e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.257547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb1fd-5f66-42a0-aeaf-fb1838e795e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.258064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb1fd-5f66-42a0-aeaf-fb1838e795e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.258574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb1fd-5f66-42a0-aeaf-fb1838e795e1 admin admin] PATH_INFO: `/v3/projects/0270d26dfd4b444dbbc070d2646e6644/users/3aad73839e54430db6099345c7a03f26/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.297265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:53.306781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb1fd-5f66-42a0-aeaf-fb1838e795e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0270d26dfd4b444dbbc070d2646e6644, user_id=3aad73839e54430db6099345c7a03f26, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.306781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb1fd-5f66-42a0-aeaf-fb1838e795e1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.363331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 962/1942] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:53 2022] PUT /identity/v3/projects/b578c7a6ec844b5683da638eda094a78/users/7a9546cd3ae1447f91adbc678e5936d7/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:53.381457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.456854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 981/1943] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:53 2022] PUT /identity/v3/projects/0270d26dfd4b444dbbc070d2646e6644/users/3aad73839e54430db6099345c7a03f26/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:53.459273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.459962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.460294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.501648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] MFA Rules not processed for user `7a9546cd3ae1447f91adbc678e5936d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:53.503568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.505457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40374c2-c2af-4d32-97ab-8f985cad49ae admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.605138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.605823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.606136 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.606397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.607171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:53.607483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.609902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.639280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 963/1944] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:53.642536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.652305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b9192-1f6c-4b7e-8095-d84b4a85b393 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.653052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 982/1945] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:53.653952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.668519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.668519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.668519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.668519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.669170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.669170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.673470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46688-f0af-4453-8f26-1030f510d7d7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.678735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.679421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.679730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.680021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.684024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.684241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 964/1946] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:53.684241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.684618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.685697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.787491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16187-7e93-4b40-9db7-dc59911a84aa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.792763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.793586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.793870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.794146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.808342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 983/1947] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:53.809394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.821211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.823745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.847174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 965/1948] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:53.848746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.869501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e218b7-b4ae-49d7-aa82-c656a5cd022e service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.947385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294911a-cf2a-4b21-afa6-ac0e9c097d36 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.957502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a316bd-c799-43d0-a31d-972890d9ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.958452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a316bd-c799-43d0-a31d-972890d9ae22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.958723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a316bd-c799-43d0-a31d-972890d9ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.959008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a316bd-c799-43d0-a31d-972890d9ae22 admin admin] PATH_INFO: `/v3/projects/0270d26dfd4b444dbbc070d2646e6644/users/3aad73839e54430db6099345c7a03f26/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.962674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a316bd-c799-43d0-a31d-972890d9ae22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0270d26dfd4b444dbbc070d2646e6644, user_id=3aad73839e54430db6099345c7a03f26, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.965919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a316bd-c799-43d0-a31d-972890d9ae22 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.982738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 984/1949] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:53 2022] PUT /identity/v3/projects/0270d26dfd4b444dbbc070d2646e6644/users/3aad73839e54430db6099345c7a03f26/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:53.995676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.995989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.996249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.027051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.030097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.030388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.030670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.032232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.034682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.056157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] MFA Rules not processed for user `3aad73839e54430db6099345c7a03f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:54.057522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:54.157236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 985/1950] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:54.170075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.189474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 966/1951] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:54.194763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.214331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3e85-61de-4ed2-8948-5dd56a31bb45 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.245112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa154f4-45f5-4eec-839f-52bf83d1dd95 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.249277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.250508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.250795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.251693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.262168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.263786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.280481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 986/1952] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:54.314416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.315527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.315984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.316383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.317086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.319021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.332371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 967/1953] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:54.336798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.349616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6f62-8133-46ac-8635-8c8dede5a1d0 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.355418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b2f1-f177-4e38-bb25-182758d2d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.356111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b2f1-f177-4e38-bb25-182758d2d0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.356429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b2f1-f177-4e38-bb25-182758d2d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.356714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b2f1-f177-4e38-bb25-182758d2d0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.357460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b2f1-f177-4e38-bb25-182758d2d0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.359382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b2f1-f177-4e38-bb25-182758d2d0ed admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.371020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 987/1954] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:54.376082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.386847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b9e86-c5d0-4e79-89d7-a12e4543dccb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.393281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.394418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.395181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.395181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] PATH_INFO: `/v3/projects/b3c75f8dc34748a3a7375c292b4a63ff/users/d05bb78e87574c9c90fd26cc0060311f/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.416513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c75f8dc34748a3a7375c292b4a63ff, user_id=d05bb78e87574c9c90fd26cc0060311f, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.419428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.560393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 968/1955] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:54 2022] PUT /identity/v3/projects/b3c75f8dc34748a3a7375c292b4a63ff/users/d05bb78e87574c9c90fd26cc0060311f/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:54.573191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.573480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.573770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.605218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] MFA Rules not processed for user `d05bb78e87574c9c90fd26cc0060311f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:54.606542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:54.618054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:54.721814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 988/1956] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:54.731176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.818247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1a9ad-d39b-4369-9fcc-e2f07ccbbd61 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.824546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.825695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.826170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.826644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.827551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.830466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.065046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 969/1957] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:37:54 2022] POST /identity/v3/projects => generated 383 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:55.069731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:55.104130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b68a-8639-486a-ab64-236a601a4364 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:55.241046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:55.241701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.242404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.242867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:55.244010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:55.253143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.409139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 989/1958] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:37:55 2022] POST /identity/v3/users => generated 298 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:55.420700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:55.443643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62286213-d312-470c-a3a1-4c1b7fbfea37 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:55.452256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:55.463491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.463491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.463491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:55.463491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:55.463491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.486123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 970/1959] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:55.490619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:55.520506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567e60-66ad-47ea-89f7-e7a7a69c023d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:55.542723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:55.544274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.544800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.545468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] PATH_INFO: `/v3/projects/ed73f937a5ce475ab3838bbf2630c1db/users/3d07787ddcb94eeca55f100c8be3650b/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:55.596404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed73f937a5ce475ab3838bbf2630c1db, user_id=3d07787ddcb94eeca55f100c8be3650b, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:55.604907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.735593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 990/1960] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:55 2022] PUT /identity/v3/projects/ed73f937a5ce475ab3838bbf2630c1db/users/3d07787ddcb94eeca55f100c8be3650b/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:55.741924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:55.763100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc55e57-f461-440b-91ca-ab8283b86397 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:55.806039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:55.897490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436533ad-3932-435e-8d47-f916f58df944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:55.899262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436533ad-3932-435e-8d47-f916f58df944 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.900537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436533ad-3932-435e-8d47-f916f58df944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.901122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436533ad-3932-435e-8d47-f916f58df944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:55.903309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436533ad-3932-435e-8d47-f916f58df944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:55.907750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436533ad-3932-435e-8d47-f916f58df944 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.923249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 971/1961] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:55.933646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:55.953304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961cc80-baf3-424d-9379-0c8c4ff85bca admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:55.962558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:55.964121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.964544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.965015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] PATH_INFO: `/v3/projects/ed73f937a5ce475ab3838bbf2630c1db/users/3d07787ddcb94eeca55f100c8be3650b/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:55.968921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed73f937a5ce475ab3838bbf2630c1db, user_id=3d07787ddcb94eeca55f100c8be3650b, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:55.972285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.986417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 991/1962] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:37:55 2022] PUT /identity/v3/projects/ed73f937a5ce475ab3838bbf2630c1db/users/3d07787ddcb94eeca55f100c8be3650b/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:55.997298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.997594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.997875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:56.027732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] MFA Rules not processed for user `3d07787ddcb94eeca55f100c8be3650b`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:56.029055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:56.158092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 972/1963] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:56.188742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:56.190599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:56.312120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc0443-36d9-471a-8bc4-b5c96a89fe7a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:56.325078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:56.325078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:56.325078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:56.325078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:56.343043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:56.347949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:56.367957 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 992/1964] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:56.799594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:56.819548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959bea2-e3ee-436f-b5ba-8469966b0284 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:56.828474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:56.829186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:56.829469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:56.833570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:56.833570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:57.273154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:57.273154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:57.273154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 973/1965] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:57.936366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:57.943303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:57.959486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f665-2db3-4752-8ef9-1b7c8e14a23f service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:57.973413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eef79-5828-46d3-945b-777ec4dd58d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:57.976193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eef79-5828-46d3-945b-777ec4dd58d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:57.976193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eef79-5828-46d3-945b-777ec4dd58d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:57.976193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eef79-5828-46d3-945b-777ec4dd58d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:58.061249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eef79-5828-46d3-945b-777ec4dd58d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:58.061249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eef79-5828-46d3-945b-777ec4dd58d2 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:58.071209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:58.083793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 993/1966] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:37:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:59.312966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:59.419034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0ff5d-75a1-4c4a-adb9-07b9545a7d8b service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:59.430629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:59.430629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:59.430629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:59.430629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] PATH_INFO: `/v3/users/d05bb78e87574c9c90fd26cc0060311f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:59.432230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05bb78e87574c9c90fd26cc0060311f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:59.434772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:59.711795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05bb78e87574c9c90fd26cc0060311f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.788648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05bb78e87574c9c90fd26cc0060311f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.789675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05bb78e87574c9c90fd26cc0060311f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.853318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05bb78e87574c9c90fd26cc0060311f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.859886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05bb78e87574c9c90fd26cc0060311f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.924637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 974/1967] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:37:59 2022] DELETE /identity/v3/users/d05bb78e87574c9c90fd26cc0060311f => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:59.926099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:59.927701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:59.928177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:59.948660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:59.950412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.037539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 994/1968] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:00.043889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.048849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.200376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c2ff-0823-4a05-9be1-ecc13928e45d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.207442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.208659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.209175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.209671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.240627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.242282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.270629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 975/1969] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:01.226701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.227808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:01.259651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613bb75-b4e4-4aac-a457-8da24fc0357b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.269091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.270183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.270670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.271371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] PATH_INFO: `/v3/projects/b3c75f8dc34748a3a7375c292b4a63ff` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.273274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c75f8dc34748a3a7375c292b4a63ff)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.275513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.336040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:01.468902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:01.483333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c75f8dc34748a3a7375c292b4a63ff', 'request_id': 'req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.575778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c75f8dc34748a3a7375c292b4a63ff', 'request_id': 'req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.583434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c75f8dc34748a3a7375c292b4a63ff', 'request_id': 'req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.603835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.605341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:01.615388 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] The token cache is being invalidate because project b3c75f8dc34748a3a7375c292b4a63ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:01.616726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.616726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.618220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 995/1970] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:01 2022] DELETE /identity/v3/projects/b3c75f8dc34748a3a7375c292b4a63ff => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:01.622494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.623881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:01.663536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f820cd-0a3c-4b16-8ac1-121cd4d9b736 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.724610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a48a5d-e68b-4be0-8cc6-0a6e9d9e9fa2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.729739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.731483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.731622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.731858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] PATH_INFO: `/v3/users/3d07787ddcb94eeca55f100c8be3650b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.733156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d07787ddcb94eeca55f100c8be3650b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.735181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.746678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.748051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.748543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.748940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] PATH_INFO: `/v3/users/26155ca287a940d28c1505aa0be162ea` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.751307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26155ca287a940d28c1505aa0be162ea)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.754855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.993564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d07787ddcb94eeca55f100c8be3650b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.024313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26155ca287a940d28c1505aa0be162ea'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.135447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d07787ddcb94eeca55f100c8be3650b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.136062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d07787ddcb94eeca55f100c8be3650b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.136695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d07787ddcb94eeca55f100c8be3650b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.149956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d07787ddcb94eeca55f100c8be3650b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.164721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 996/1971] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:01 2022] DELETE /identity/v3/users/3d07787ddcb94eeca55f100c8be3650b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:02.218259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26155ca287a940d28c1505aa0be162ea'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.219147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26155ca287a940d28c1505aa0be162ea'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.245438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26155ca287a940d28c1505aa0be162ea'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.246240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26155ca287a940d28c1505aa0be162ea'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.264362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 976/1972] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:01 2022] DELETE /identity/v3/users/26155ca287a940d28c1505aa0be162ea => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:02.629051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:02.630639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.677170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:02.678788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.702252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298cbf6-f137-4ca7-be3f-64300528c278 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:02.755256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ad73a-cd6e-4205-bb4e-cb9287c12f0f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:02.764820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:02.766140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:02.769081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:02.769081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] PATH_INFO: `/v3/projects/ed73f937a5ce475ab3838bbf2630c1db` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:02.769405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:02.769579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed73f937a5ce475ab3838bbf2630c1db)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:02.769732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:02.769732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:02.769732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] PATH_INFO: `/v3/projects/b2391788ecae49f292810c2ba1118193` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:02.770602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:02.770784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2391788ecae49f292810c2ba1118193)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:02.772722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:02.922523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed73f937a5ce475ab3838bbf2630c1db', 'request_id': 'req-cf46e852-6bfc-491c-ab68-990fe4a49742'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.923654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2391788ecae49f292810c2ba1118193', 'request_id': 'req-53322945-0bed-482c-a8cd-d5da2a8189c2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.930907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed73f937a5ce475ab3838bbf2630c1db', 'request_id': 'req-cf46e852-6bfc-491c-ab68-990fe4a49742'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.942082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed73f937a5ce475ab3838bbf2630c1db', 'request_id': 'req-cf46e852-6bfc-491c-ab68-990fe4a49742'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.015701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2391788ecae49f292810c2ba1118193', 'request_id': 'req-53322945-0bed-482c-a8cd-d5da2a8189c2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.019979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2391788ecae49f292810c2ba1118193', 'request_id': 'req-53322945-0bed-482c-a8cd-d5da2a8189c2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.033734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] The token cache is being invalidate because project b2391788ecae49f292810c2ba1118193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:03.034042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.034707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-53322945-0bed-482c-a8cd-d5da2a8189c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.036524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 997/1973] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:02 2022] DELETE /identity/v3/projects/b2391788ecae49f292810c2ba1118193 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:03.041334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad24b89-7daf-4496-a49e-b36663664682 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.041692 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad24b89-7daf-4496-a49e-b36663664682 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.041987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad24b89-7daf-4496-a49e-b36663664682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.086218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cad24b89-7daf-4496-a49e-b36663664682 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:03.087458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cad24b89-7daf-4496-a49e-b36663664682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.148883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] The token cache is being invalidate because project ed73f937a5ce475ab3838bbf2630c1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:03.149476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.150619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-cf46e852-6bfc-491c-ab68-990fe4a49742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.160691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 977/1974] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:02 2022] DELETE /identity/v3/projects/ed73f937a5ce475ab3838bbf2630c1db => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:03.162610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b574-6b8e-4e07-adf7-498504616307 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.162898 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b574-6b8e-4e07-adf7-498504616307 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.163177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b574-6b8e-4e07-adf7-498504616307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.181145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 998/1975] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:03.189109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.189460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.189747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.191694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7d78b574-6b8e-4e07-adf7-498504616307 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:03.194322 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7d78b574-6b8e-4e07-adf7-498504616307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.209220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 978/1976] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:03.210853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.211144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.211432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.215648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:03.217572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.232407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 999/1977] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:03.234601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.239946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:03.245058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.245906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651264f-f791-4987-9ada-248bc2bdf0a5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.249889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.250640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.250981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.251308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.252103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:03.252504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.253028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 979/1978] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:03.254362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.257993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.268113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1000/1979] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:03.269329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fe926-5f95-4ec8-b925-fe4692ecff92 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.274289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.274968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.275251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.275647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.276408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:03.277034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.277183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.278807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.287987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55bc3-8a71-4545-9f26-f952973cee15 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.293612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.294426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 980/1980] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:03.296519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.297031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.298181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.298687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.299593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.302353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.310479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0060e6-aa7b-4bf4-9c59-94a54354b8f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.315973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.317389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.318035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.318523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.319291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.321627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.435713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1001/1981] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:03.441513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.482869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 981/1982] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:03.491551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.542550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3de6-2f1b-4e9a-905e-5ca1ece8d592 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.604805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923160-8dab-4cae-b6de-daf80e19aed4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.610729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.615301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.615301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.615301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.615301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.615301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.615851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.616599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.616886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.617167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.618478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.621110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.774770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 982/1983] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:03.775326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1002/1984] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/users => generated 284 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:03.780109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.781877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.793486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896e7c4-33d6-4885-a874-ecf04ef341d8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.794834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1025-0e4a-4a64-9ed4-cfa139d350bf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.800684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.801750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.802287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.802687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.803782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.805403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.805905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.808142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.808142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.808142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.808142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.809114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.821252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 983/1985] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:03.825033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1003/1986] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:03.825916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.831520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.842854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01497180-32f9-4a12-8fbb-01641ef133ac admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.846107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9699a-cfc6-41b9-b7d0-cb28603b2676 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.851350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.852522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.852963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.853476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.854561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.854964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.855508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.855906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.856286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.857152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.857334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.859760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.874648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1004/1987] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:03.874936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 984/1988] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:03.878771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.880778 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.890017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0e16a-a638-4037-a59e-73a4730c35da admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.893105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c54e39-97b2-4e23-8b25-9a7700b1eafc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.898109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427c2ba-47e5-4327-9708-98bc8c9f7510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.898337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd229451-4b06-44c3-b136-65f628e2036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.899194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c2ba-47e5-4327-9708-98bc8c9f7510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.899385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229451-4b06-44c3-b136-65f628e2036b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.899706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c2ba-47e5-4327-9708-98bc8c9f7510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.899820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229451-4b06-44c3-b136-65f628e2036b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.900039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c2ba-47e5-4327-9708-98bc8c9f7510 admin admin] PATH_INFO: `/v3/projects/cbb6a6ab1b184113ae560972671b733a/users/40b6873f1e484c72996bf1a949eee5c4/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.900189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229451-4b06-44c3-b136-65f628e2036b admin admin] PATH_INFO: `/v3/projects/88373512a9a4430cae78d0963e73b106/users/01155ddf2b4f4cecaada75efabb4feb6/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.917744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427c2ba-47e5-4327-9708-98bc8c9f7510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb6a6ab1b184113ae560972671b733a, user_id=40b6873f1e484c72996bf1a949eee5c4, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.920684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427c2ba-47e5-4327-9708-98bc8c9f7510 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.925407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd229451-4b06-44c3-b136-65f628e2036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88373512a9a4430cae78d0963e73b106, user_id=01155ddf2b4f4cecaada75efabb4feb6, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.928875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd229451-4b06-44c3-b136-65f628e2036b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.081081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1005/1989] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:03 2022] PUT /identity/v3/projects/cbb6a6ab1b184113ae560972671b733a/users/40b6873f1e484c72996bf1a949eee5c4/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:04.095367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.096806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.097041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.129238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] MFA Rules not processed for user `40b6873f1e484c72996bf1a949eee5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:04.130972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.140814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 985/1990] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:03 2022] PUT /identity/v3/projects/88373512a9a4430cae78d0963e73b106/users/01155ddf2b4f4cecaada75efabb4feb6/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:04.153218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.153501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.153953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.192302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] MFA Rules not processed for user `01155ddf2b4f4cecaada75efabb4feb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:04.193630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.205798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:04.246146 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:04.250441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1006/1991] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:04.257231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.316968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 986/1992] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:04.336094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea7158-355c-4bfb-afea-41f9d41601be None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.341164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.341880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.342162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.342437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.343677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.345732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.391289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.392743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.469855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1007/1993] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:04.470647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06cf78-a742-42fc-9b20-aa9c4c9e64be None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.473968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.527365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.528123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.528383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.528666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.554349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618cbef-12b1-4571-8f62-e6f3fb86ec63 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.560987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.561924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.562331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.562708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.563506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.567004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.628188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.629675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.638987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 987/1994] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:04.644458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.644458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.652487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16f67-32eb-410e-b15d-4343cfa143d8 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.657220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.657874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.658152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.658425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.660231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.687223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1008/1995] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:04.691572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.705525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137362e-a61b-43dc-8fd3-9175f3317ea6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.710857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.712156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.712484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.712785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.713670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.715414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.732055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1009/1996] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:04.733103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.744228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.746287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.754006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30e86-c35e-4866-9ca2-c4650799ceb6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.758344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 988/1997] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:04.760579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.765534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.765534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.765534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] PATH_INFO: `/v3/projects/3b9a777e0c904eeba2e473b3daf7fd8a/users/eb8c1dda3e9c4b55a49ffd586df70bf6/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.787616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9a777e0c904eeba2e473b3daf7fd8a, user_id=eb8c1dda3e9c4b55a49ffd586df70bf6, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.793639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.893703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1010/1998] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:04 2022] PUT /identity/v3/projects/3b9a777e0c904eeba2e473b3daf7fd8a/users/eb8c1dda3e9c4b55a49ffd586df70bf6/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:04.898586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.909907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef55c3-cfa5-4d50-924c-2c59ca8678eb service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.978538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4865-d442-438f-b4b9-c6ba6ba32fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.979259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4865-d442-438f-b4b9-c6ba6ba32fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.979549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4865-d442-438f-b4b9-c6ba6ba32fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.979818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4865-d442-438f-b4b9-c6ba6ba32fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.980624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4865-d442-438f-b4b9-c6ba6ba32fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.982275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4865-d442-438f-b4b9-c6ba6ba32fc4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.997557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 989/1999] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:04.999476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.009584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d11c-f504-4b51-bbf4-ae618898f084 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.014288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.015790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.016071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.016372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] PATH_INFO: `/v3/projects/3b9a777e0c904eeba2e473b3daf7fd8a/users/eb8c1dda3e9c4b55a49ffd586df70bf6/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.018330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9a777e0c904eeba2e473b3daf7fd8a, user_id=eb8c1dda3e9c4b55a49ffd586df70bf6, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.021032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.033369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1011/2000] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:04 2022] PUT /identity/v3/projects/3b9a777e0c904eeba2e473b3daf7fd8a/users/eb8c1dda3e9c4b55a49ffd586df70bf6/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:05.051648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.051953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.052304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.083616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] MFA Rules not processed for user `eb8c1dda3e9c4b55a49ffd586df70bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:05.085145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:05.184025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 990/2001] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:05.677898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.735045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff9ebf-b91e-45ab-986a-ae267f511bc5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.739760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e06c5a-691c-4d0e-93f7-d7896f9b113a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.740788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06c5a-691c-4d0e-93f7-d7896f9b113a service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.741084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06c5a-691c-4d0e-93f7-d7896f9b113a service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.741382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06c5a-691c-4d0e-93f7-d7896f9b113a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.805445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e06c5a-691c-4d0e-93f7-d7896f9b113a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.806965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e06c5a-691c-4d0e-93f7-d7896f9b113a service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.817924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1012/2002] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:06.721031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:06.838661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:08.398661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:09.073226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:09.074717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:09.185784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a0b26-074c-4546-af76-e6bce5d64304 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:09.191491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:09.192546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:09.192894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:09.193237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] PATH_INFO: `/v3/users/46751a87948c498a867f47e880e7f7b7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:09.194636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46751a87948c498a867f47e880e7f7b7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:09.196970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:09.370542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:09.503950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46751a87948c498a867f47e880e7f7b7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:09.604129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46751a87948c498a867f47e880e7f7b7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:09.605113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46751a87948c498a867f47e880e7f7b7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:09.625790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46751a87948c498a867f47e880e7f7b7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:09.627091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46751a87948c498a867f47e880e7f7b7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:09.643614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 991/2003] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:09 2022] DELETE /identity/v3/users/46751a87948c498a867f47e880e7f7b7 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:09.648577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:09.648932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:09.649217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:09.667681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:09.668949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:09.733689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1013/2004] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:09.748634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:09.750238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:09.832104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fa0bf-34dc-4d28-9e65-4ffe1783f192 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:09.835759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1f07d-808b-455e-a272-97bdd60564c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:09.836532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f07d-808b-455e-a272-97bdd60564c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:09.836814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f07d-808b-455e-a272-97bdd60564c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:09.837087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f07d-808b-455e-a272-97bdd60564c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:09.847010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f07d-808b-455e-a272-97bdd60564c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:09.848531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f07d-808b-455e-a272-97bdd60564c6 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:09.858340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 992/2005] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:10.411498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:10.413837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:10.427081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96c20e-90eb-48aa-a4a6-5377321a6a17 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:10.432627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:10.434118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:10.438431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:10.438839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] PATH_INFO: `/v3/projects/4e365c97e4fe4ea489d096ba7e5fd22e` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:10.440434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e365c97e4fe4ea489d096ba7e5fd22e)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:10.442538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:10.651766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e365c97e4fe4ea489d096ba7e5fd22e', 'request_id': 'req-a5437de3-1be6-470c-b37f-c7449dca7952'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:10.817894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e365c97e4fe4ea489d096ba7e5fd22e', 'request_id': 'req-a5437de3-1be6-470c-b37f-c7449dca7952'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:10.825086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e365c97e4fe4ea489d096ba7e5fd22e', 'request_id': 'req-a5437de3-1be6-470c-b37f-c7449dca7952'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:10.836362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] The token cache is being invalidate because project 4e365c97e4fe4ea489d096ba7e5fd22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:10.836656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:10.837326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-a5437de3-1be6-470c-b37f-c7449dca7952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:10.838984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1014/2006] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:10 2022] DELETE /identity/v3/projects/4e365c97e4fe4ea489d096ba7e5fd22e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:10.844511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:10.845059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:10.845059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:10.876853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:10.878130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:10.943594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 993/2007] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:10.952087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:10.952528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:10.952892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:10.973179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:10.974442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:10.983933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1015/2008] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:10.989040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:10.997196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:11.001258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8464b-21f7-46ee-9483-480a38bd4732 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.006038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.006709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.007094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.007425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.008157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:11.008511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.010133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.022495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 994/2009] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:11.027518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.038835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef258b1-7ba4-420f-b848-2e284ff01495 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.045339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.046714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.047079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.047343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.048366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.050200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.121258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.123140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:11.136368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dce4ac-7179-4064-b24c-a69958bca377 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.141866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.142758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.143048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.143333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] PATH_INFO: `/v3/users/c716345724824c5985547cc09dee3a8d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.144637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c716345724824c5985547cc09dee3a8d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.146573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.164476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:11.228989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1016/2010] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:11.233786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.303941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c263-947d-4a14-84ac-3ea77c4b6b44 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.309512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.310241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.310519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.310910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.311881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.313701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.351797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c716345724824c5985547cc09dee3a8d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:11.403986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1017/2011] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:11 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:11.408685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.422481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c298eb-4e9e-454e-945d-3570fedc597a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.427447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.428107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.428616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.428894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.429691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.436259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.445148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1018/2012] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:11.446193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.457449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc988f04-a192-4941-a3e7-e85125f644a0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.462657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.463550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.463897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.464156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.465013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c716345724824c5985547cc09dee3a8d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:11.467856 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.468144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c716345724824c5985547cc09dee3a8d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:11.468239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.482436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1019/2013] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:11.487881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.490273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c716345724824c5985547cc09dee3a8d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:11.491056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aec4d3a0-2f73-4820-9ab1-7460948760b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c716345724824c5985547cc09dee3a8d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:11.502711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956cc04-39ee-4d6a-a042-376a288736e1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.507141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 995/2014] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:11 2022] DELETE /identity/v3/users/c716345724824c5985547cc09dee3a8d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:11.512256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.512577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.512855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.529730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93dddf-72c4-48e7-b1cc-5b91af7611ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.530656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93dddf-72c4-48e7-b1cc-5b91af7611ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.530939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93dddf-72c4-48e7-b1cc-5b91af7611ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.531386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93dddf-72c4-48e7-b1cc-5b91af7611ec admin admin] PATH_INFO: `/v3/projects/561d4e8d355b40439009568d16509636/users/24663ddf3b2c4d9ba4a8397f5d43f5e4/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.546596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:11.548142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:11.552447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93dddf-72c4-48e7-b1cc-5b91af7611ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=561d4e8d355b40439009568d16509636, user_id=24663ddf3b2c4d9ba4a8397f5d43f5e4, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.556060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93dddf-72c4-48e7-b1cc-5b91af7611ec admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.627507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 996/2015] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:11.639956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.641909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:11.700687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1020/2016] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:11 2022] PUT /identity/v3/projects/561d4e8d355b40439009568d16509636/users/24663ddf3b2c4d9ba4a8397f5d43f5e4/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:11.706640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.706859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.707380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.713884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67af83a-1405-4826-8d08-a08baf111abf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.738821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] MFA Rules not processed for user `24663ddf3b2c4d9ba4a8397f5d43f5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:11.740300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:11.816034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.817509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.817849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.818217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.857673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1021/2017] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:11.858888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:11.860724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:11.916867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.918807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:11.932120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 997/2018] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:11.955359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e1689-8e6a-4cd1-abba-9e569e5d5fdc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:11.967168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:11.967168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.967168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.967168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.967528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:11.969242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.142574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1022/2019] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:12.146986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.157821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f004eb0-973f-4017-a470-fa2129f0f4d3 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.226961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.233644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.233949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.234260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.234975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.238042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.353714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 998/2020] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:12 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:12.354984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.365981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998f84-34ad-45ff-a2ac-89ffd47e1fa7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.371250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.371938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.372224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.372535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.373375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.375049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.386583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1023/2021] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:12.396800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.407811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e256d9e-5406-4f38-8422-1d927f1e162f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.412719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.413439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.413722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.414010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.414728 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.417633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.430055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 999/2022] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:12.434406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.459950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67f9d-930a-4963-865a-62be4f040a8e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.459950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.459950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.459950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.460290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] PATH_INFO: `/v3/projects/dbe1d77387384700b76736f04ff4c5f7/users/4babdd9cdcb5488b903c6eee16633b5d/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.462713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.466380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.483646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe1d77387384700b76736f04ff4c5f7, user_id=4babdd9cdcb5488b903c6eee16633b5d, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.484366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60894c8-8a62-4822-92a5-ca868e744d42 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.486875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.503123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.503799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.504751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.504751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] PATH_INFO: `/v3/projects/8404dc88ee6f4dc8a6a1ddc4d5367c88` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.506636 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8404dc88ee6f4dc8a6a1ddc4d5367c88)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.508853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.594409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1024/2023] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:12 2022] PUT /identity/v3/projects/dbe1d77387384700b76736f04ff4c5f7/users/4babdd9cdcb5488b903c6eee16633b5d/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:12.597502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.600519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.669788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc16ba-1b48-46fd-add7-1b0e28ee603d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.673228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8404dc88ee6f4dc8a6a1ddc4d5367c88', 'request_id': 'req-d6f99a43-901a-4678-a9a4-5dc5927b31c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:12.681167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8404dc88ee6f4dc8a6a1ddc4d5367c88', 'request_id': 'req-d6f99a43-901a-4678-a9a4-5dc5927b31c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:12.693600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8404dc88ee6f4dc8a6a1ddc4d5367c88', 'request_id': 'req-d6f99a43-901a-4678-a9a4-5dc5927b31c3'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:12.729073 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.729734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.730015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.730290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.732222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.805969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.807438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4725dac-c5e5-4222-af62-f9d0577da5d6 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.818908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1025/2024] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:12.820689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] The token cache is being invalidate because project 8404dc88ee6f4dc8a6a1ddc4d5367c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:12.820985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:12.821723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:12.827085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1000/2025] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:12 2022] DELETE /identity/v3/projects/8404dc88ee6f4dc8a6a1ddc4d5367c88 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:12.827363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.827720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.827971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.828170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.829572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.836486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:12.870709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] MFA Rules not processed for user `4babdd9cdcb5488b903c6eee16633b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:12.873659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.927894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99a43-901a-4678-a9a4-5dc5927b31c3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:12.934507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:12.936574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.941432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.941432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] PATH_INFO: `/v3/users/9f194c3356794731b1fca596d877fdba` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.941432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f194c3356794731b1fca596d877fdba)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:12.941894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:12.974496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1026/2026] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:12.975451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:12.977131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.991122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e16ae-0a79-4723-b409-a0b6910d64e2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:13.006041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:13.006933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.007277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.007562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] PATH_INFO: `/v3/users/7a9546cd3ae1447f91adbc678e5936d7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.009206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9546cd3ae1447f91adbc678e5936d7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:13.011209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:13.228729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f194c3356794731b1fca596d877fdba'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.242855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9546cd3ae1447f91adbc678e5936d7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.329764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f194c3356794731b1fca596d877fdba'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.330472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f194c3356794731b1fca596d877fdba'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.345475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f194c3356794731b1fca596d877fdba'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.346343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f194c3356794731b1fca596d877fdba'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.361861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1001/2027] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:12 2022] DELETE /identity/v3/users/9f194c3356794731b1fca596d877fdba => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:13.363337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:13.365004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:13.452069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9546cd3ae1447f91adbc678e5936d7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.453035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9546cd3ae1447f91adbc678e5936d7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.453619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9546cd3ae1447f91adbc678e5936d7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.460549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38376-8051-4fb9-93ba-d6f3b8dc644a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:13.467593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:13.468593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.468885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.469173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.469896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:13.473348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:13.481833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b7edf474-2a5d-42f8-a6ea-45a3873766c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9546cd3ae1447f91adbc678e5936d7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:13.503033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1027/2028] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:12 2022] DELETE /identity/v3/users/7a9546cd3ae1447f91adbc678e5936d7 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:13.508246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.508584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.508963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.529990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:13.531502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:13.558175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:13.611208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1002/2029] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:13 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:13.612967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:13.628721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:13.644583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1028/2030] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:13.657941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:13.659970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:13.730573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:13.758374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38857bcd-af3d-4971-8a22-c0c054b1bba6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:13.774776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db698c-f7ba-4ce5-8db7-8acda2226ae4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:13.785058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:13.786487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.787012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.787376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.788212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:13.790529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:13.833245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:13.834342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.834860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.835358 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.852976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:13.859238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:13.872539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1029/2031] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:13.906183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1003/2032] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:13 2022] POST /identity/v3/users => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:13.911651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:13.919701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e03df8-22b3-484e-8907-6288ee91bbb7 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:13.925225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:13.925906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.926196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.926479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.927218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:13.928917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:13.945102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1030/2033] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:13.950355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:13.962968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27f5f-f309-4c03-9042-39b97826dc1e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:13.968937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:13.969975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:13.970367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:13.970720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] PATH_INFO: `/v3/projects/bc60a266c90c4f5eb87085425b067aae/users/ff17992a7de74cb7871d736953082ae0/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:13.989428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc60a266c90c4f5eb87085425b067aae, user_id=ff17992a7de74cb7871d736953082ae0, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:13.993065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:14.068778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:14.070622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.087701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec2f6-1007-4d71-b624-c6714a250e16 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:14.099694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:14.100925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:14.101449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:14.102053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] PATH_INFO: `/v3/projects/0dad9cbc79f64a37a4cd8610a3a97882` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:14.104946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dad9cbc79f64a37a4cd8610a3a97882)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:14.109344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:14.205430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1004/2034] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:13 2022] PUT /identity/v3/projects/bc60a266c90c4f5eb87085425b067aae/users/ff17992a7de74cb7871d736953082ae0/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:14.209608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:14.271610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dad9cbc79f64a37a4cd8610a3a97882', 'request_id': 'req-c2ce163c-6764-459b-87a1-4366112cee4d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.315030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef245e-4207-4759-86e9-1e8e3624d350 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:14.360510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dad9cbc79f64a37a4cd8610a3a97882', 'request_id': 'req-c2ce163c-6764-459b-87a1-4366112cee4d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.368720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dad9cbc79f64a37a4cd8610a3a97882', 'request_id': 'req-c2ce163c-6764-459b-87a1-4366112cee4d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.386814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] The token cache is being invalidate because project 0dad9cbc79f64a37a4cd8610a3a97882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:14.387552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.389232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.393593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1031/2035] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:14 2022] DELETE /identity/v3/projects/0dad9cbc79f64a37a4cd8610a3a97882 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:14.397775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:14.400524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.410494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:14.412014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:14.412724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:14.413275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:14.414664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:14.417429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:14.422902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce163c-6764-459b-87a1-4366112cee4d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:14.431988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:14.433447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:14.433897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:14.434339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] PATH_INFO: `/v3/users/3aad73839e54430db6099345c7a03f26` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:14.436448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aad73839e54430db6099345c7a03f26)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:14.439986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1005/2036] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:14.440142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:14.441760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:14.444577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.458264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48915-6624-4a62-a54c-c7a8a8422347 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:14.471803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96aab-3fb4-44e6-9d4d-53e054dab966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:14.471803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96aab-3fb4-44e6-9d4d-53e054dab966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:14.471803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96aab-3fb4-44e6-9d4d-53e054dab966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:14.471803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96aab-3fb4-44e6-9d4d-53e054dab966 admin admin] PATH_INFO: `/v3/projects/bc60a266c90c4f5eb87085425b067aae/users/ff17992a7de74cb7871d736953082ae0/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:14.474128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96aab-3fb4-44e6-9d4d-53e054dab966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc60a266c90c4f5eb87085425b067aae, user_id=ff17992a7de74cb7871d736953082ae0, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:14.477546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96aab-3fb4-44e6-9d4d-53e054dab966 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:14.490860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1006/2037] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:14 2022] PUT /identity/v3/projects/bc60a266c90c4f5eb87085425b067aae/users/ff17992a7de74cb7871d736953082ae0/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:14.502418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:14.502714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:14.503004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:14.536006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] MFA Rules not processed for user `ff17992a7de74cb7871d736953082ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:14.538047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.614523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1007/2038] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:14.626948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:14.628342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.684167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aad73839e54430db6099345c7a03f26'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.689393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888fab-3c02-4a5d-af07-25940ae58f15 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:14.693233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:14.693945 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:14.694231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:14.694511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:14.696492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.784465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:14.787292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:14.805771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1008/2039] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:14.806707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:14.808239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:14.823199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aad73839e54430db6099345c7a03f26'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.823199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aad73839e54430db6099345c7a03f26'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.823485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aad73839e54430db6099345c7a03f26'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.869237 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5efefa4d-c248-438c-a6b9-ddc24e2c4786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aad73839e54430db6099345c7a03f26'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:14.904195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1032/2040] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:14 2022] DELETE /identity/v3/users/3aad73839e54430db6099345c7a03f26 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:14.938775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb449-c524-4890-b2b3-504dea68bfef service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:15.046992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:15.047961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.048155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.048477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] PATH_INFO: `/v3/projects/b578c7a6ec844b5683da638eda094a78` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:15.049779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b578c7a6ec844b5683da638eda094a78)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:15.051752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:15.240556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b578c7a6ec844b5683da638eda094a78', 'request_id': 'req-0ede212b-41c5-45d1-ae9a-635ee697101e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.249113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b578c7a6ec844b5683da638eda094a78', 'request_id': 'req-0ede212b-41c5-45d1-ae9a-635ee697101e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.255284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b578c7a6ec844b5683da638eda094a78', 'request_id': 'req-0ede212b-41c5-45d1-ae9a-635ee697101e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.374429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] The token cache is being invalidate because project b578c7a6ec844b5683da638eda094a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:15.375674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.377167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.381084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1009/2041] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:14 2022] DELETE /identity/v3/projects/b578c7a6ec844b5683da638eda094a78 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:15.389314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636cd0d-2a16-47a3-bb34-67c9a75592fd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.389821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636cd0d-2a16-47a3-bb34-67c9a75592fd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.390578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636cd0d-2a16-47a3-bb34-67c9a75592fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:15.426416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8636cd0d-2a16-47a3-bb34-67c9a75592fd None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:15.428712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8636cd0d-2a16-47a3-bb34-67c9a75592fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:15.520421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:15.522003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:15.577227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1033/2042] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:15.578435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.578730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.579011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:15.603960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:15.605566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:15.615448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1034/2043] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:15.626916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:15.641364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af98ff4-0d0e-4a30-b218-c4270ee19b3d None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:15.645420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede212b-41c5-45d1-ae9a-635ee697101e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:15.650412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:15.650616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:15.651433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.651663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.651769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.651997 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] PATH_INFO: `/v3/projects/0270d26dfd4b444dbbc070d2646e6644` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:15.652184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.652734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:15.653353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0270d26dfd4b444dbbc070d2646e6644)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:15.654086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:15.655395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:15.655883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:15.658178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:15.678674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1035/2044] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:15.685004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:15.699325 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd602-058e-4b26-9f16-e0a98aa0544b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:15.706805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:15.707678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.707970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.708413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:15.720301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:15.720301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:15.835344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0270d26dfd4b444dbbc070d2646e6644', 'request_id': 'req-2815d69b-a0d9-4b6c-ae7b-b900c349739c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.846326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0270d26dfd4b444dbbc070d2646e6644', 'request_id': 'req-2815d69b-a0d9-4b6c-ae7b-b900c349739c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.858225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0270d26dfd4b444dbbc070d2646e6644', 'request_id': 'req-2815d69b-a0d9-4b6c-ae7b-b900c349739c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.895339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1036/2045] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:15 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:15.897363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:15.989635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8d70-5974-4b6f-b87b-ab53491fa369 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:15.996003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] The token cache is being invalidate because project 0270d26dfd4b444dbbc070d2646e6644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:15.996685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.998780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:15.998909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-2815d69b-a0d9-4b6c-ae7b-b900c349739c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:15.998991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:15.999251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:15.999629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.000441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.001083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1010/2046] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:15 2022] DELETE /identity/v3/projects/0270d26dfd4b444dbbc070d2646e6644 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:16.002822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.010147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef375b-b569-401c-974d-c1a065adfb1f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.010540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef375b-b569-401c-974d-c1a065adfb1f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.011036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef375b-b569-401c-974d-c1a065adfb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.035531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-38ef375b-b569-401c-974d-c1a065adfb1f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:16.036931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-38ef375b-b569-401c-974d-c1a065adfb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:16.046371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1011/2047] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:16.052243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:16.055036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.055326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.055606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.077413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:16.078570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:16.087692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1012/2048] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:16.093015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.102595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317f06-2a48-4f02-b56e-2a89cb08e458 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.107428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.108102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.108418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.108690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.109432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:16.109807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.111414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.124971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1013/2049] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:16.129371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.140857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552325e8-4b59-42b3-96a0-0a690fc47c69 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.145733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.146399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.146687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.146967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.147669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.149691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.180689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1037/2050] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:15 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:16.181913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.183763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:16.196781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c82cbe-ec5d-4925-ae49-139725d2dff1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.202463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.203061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.203373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.203705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.204414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.206301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.216901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1038/2051] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:16.221002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.232775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ed193-63de-4c69-948e-0c8dfa4aa9d6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.238389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.239069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.239349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.239809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.239923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1014/2052] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:16 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:16.240445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.242389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.246053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.254210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1039/2053] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:16.259024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.268310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:16.272613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e3d4-1947-4870-bc77-35300f05def3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.333033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38864d-bb23-48a2-9991-3b1ba3383279 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.338139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.338839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.339125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.339407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.340150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.342239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.345894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.347420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.347913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.348276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] PATH_INFO: `/v3/projects/a7aec0311e784f57af1de74543007184/users/4b92eed1018941d0b9fd6a08f276bd87/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.374151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7aec0311e784f57af1de74543007184, user_id=4b92eed1018941d0b9fd6a08f276bd87, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.379144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.477920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1040/2054] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:16 2022] PUT /identity/v3/projects/a7aec0311e784f57af1de74543007184/users/4b92eed1018941d0b9fd6a08f276bd87/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:16.481542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.481542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:16.482186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1015/2055] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:16 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:16.483906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.494495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edba5f-dba7-488e-bb69-fce409e60b07 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.564173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14385f-6edb-452b-bc01-912f2e79f5c6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.566183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b3305-61a4-47a7-b7ce-02fb37d6948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.566877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b3305-61a4-47a7-b7ce-02fb37d6948b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.567156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b3305-61a4-47a7-b7ce-02fb37d6948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.567438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b3305-61a4-47a7-b7ce-02fb37d6948b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.568377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b3305-61a4-47a7-b7ce-02fb37d6948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.570098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b3305-61a4-47a7-b7ce-02fb37d6948b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.571225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.574285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.574285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.574285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] PATH_INFO: `/v3/users/01155ddf2b4f4cecaada75efabb4feb6` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.575312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01155ddf2b4f4cecaada75efabb4feb6)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.577519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.595288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1016/2056] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:16.595288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295760f-01fa-4671-89e4-694418895353 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.595288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295760f-01fa-4671-89e4-694418895353 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.595288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295760f-01fa-4671-89e4-694418895353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.607913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8295760f-01fa-4671-89e4-694418895353 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:16.609231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8295760f-01fa-4671-89e4-694418895353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:16.627526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1017/2057] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:16.630913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295760f-01fa-4671-89e4-694418895353 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.641877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295760f-01fa-4671-89e4-694418895353 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.646950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.647634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.647918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.648203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.648974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.650708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.661841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1018/2058] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:16.662731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.664584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:16.728529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e71be3-d680-460e-8744-b11b612821cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.733300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.733962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.734247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.734527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.744703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.746147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.758794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1019/2059] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:16.759723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:16.769927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0cb8-baa8-4efb-bf3d-10eaf1436b87 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:16.774939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2d4b7-7c53-4b5f-b329-37b238e31498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:16.775856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2d4b7-7c53-4b5f-b329-37b238e31498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:16.776138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2d4b7-7c53-4b5f-b329-37b238e31498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:16.776464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2d4b7-7c53-4b5f-b329-37b238e31498 admin admin] PATH_INFO: `/v3/projects/ef164e3cf9d64db2805193589fda3737/users/12181d26827744bcbcc83c6d7fcf207a/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:16.795696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2d4b7-7c53-4b5f-b329-37b238e31498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef164e3cf9d64db2805193589fda3737, user_id=12181d26827744bcbcc83c6d7fcf207a, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:16.798479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2d4b7-7c53-4b5f-b329-37b238e31498 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:16.922472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01155ddf2b4f4cecaada75efabb4feb6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.043511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01155ddf2b4f4cecaada75efabb4feb6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.044281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01155ddf2b4f4cecaada75efabb4feb6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.045740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01155ddf2b4f4cecaada75efabb4feb6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.051150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1020/2060] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:16 2022] PUT /identity/v3/projects/ef164e3cf9d64db2805193589fda3737/users/12181d26827744bcbcc83c6d7fcf207a/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:17.061830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4b491992-94e8-4e10-a5d2-8efba264ae5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01155ddf2b4f4cecaada75efabb4feb6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.063619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.064097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.064315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.074860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1041/2061] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:16 2022] DELETE /identity/v3/users/01155ddf2b4f4cecaada75efabb4feb6 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:17.080085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.080604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.080958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.095626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] MFA Rules not processed for user `12181d26827744bcbcc83c6d7fcf207a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:17.096941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.100693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:17.101817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.175611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1021/2062] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:17.181113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.183576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.186922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1042/2063] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:17.215288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d02243-eb56-4765-aa8d-3128e21cf22d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.218793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.221400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.224998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.226073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.226582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.227291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.228687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.231837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.342376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faf95a-6e4d-4318-a363-1bd2a8ccadf5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.348755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.350306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.351966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.351966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.368838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.370381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.389019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1043/2064] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:17.432537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1022/2065] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:17 2022] POST /identity/v3/projects => generated 401 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:17.434857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.449693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113130-0737-47b5-b0c5-3d6d2a5723e3 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.488208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.491201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.553195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.554517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.555660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.555660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.557107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.561691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.583674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c4361-d378-49fc-bfe9-3ab7c3d1ff99 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.591397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.592809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.593323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.593836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.597338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.708443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1044/2066] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:17 2022] POST /identity/v3/users => generated 307 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:17.708576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.710118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.715768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.721699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1023/2067] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:17.741335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2ae33-22b2-4dee-80cb-4b3fe76d0fdd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.769377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.770082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.770368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.770651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.771395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.775368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.791381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1045/2068] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:17.795661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.808027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686b85-113c-4288-9cc4-9c2cc824e3fe service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.817181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.817770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.818101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.818853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] PATH_INFO: `/v3/projects/a32f010fc01147079ea51d479d1c2a34/users/7bccd08d523c4e9b9ffa4260e54d0f46/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.850672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32f010fc01147079ea51d479d1c2a34, user_id=7bccd08d523c4e9b9ffa4260e54d0f46, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.853553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.993178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1024/2069] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:17 2022] PUT /identity/v3/projects/a32f010fc01147079ea51d479d1c2a34/users/7bccd08d523c4e9b9ffa4260e54d0f46/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:17.997051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.009184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fff04-c54e-4343-8b71-d6ddb8c5903b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.054557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.058216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.157715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.159199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.161143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.161847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.163506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.166822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.195665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1046/2070] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:18.197887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.198486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caf19-481e-4843-a83b-0279c0d14897 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.205007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.206629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.206815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.207247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] PATH_INFO: `/v3/projects/88373512a9a4430cae78d0963e73b106` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.209196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88373512a9a4430cae78d0963e73b106)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.211495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.211738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a44ad-a893-4119-bcdb-3bae264d82e9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.218666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3f35-711f-435f-b1d9-0d7345a966a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.219726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3f35-711f-435f-b1d9-0d7345a966a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.220136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3f35-711f-435f-b1d9-0d7345a966a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.220551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3f35-711f-435f-b1d9-0d7345a966a1 admin admin] PATH_INFO: `/v3/projects/a32f010fc01147079ea51d479d1c2a34/users/7bccd08d523c4e9b9ffa4260e54d0f46/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.224749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3f35-711f-435f-b1d9-0d7345a966a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32f010fc01147079ea51d479d1c2a34, user_id=7bccd08d523c4e9b9ffa4260e54d0f46, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.234810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3f35-711f-435f-b1d9-0d7345a966a1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.251683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1047/2071] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:18 2022] PUT /identity/v3/projects/a32f010fc01147079ea51d479d1c2a34/users/7bccd08d523c4e9b9ffa4260e54d0f46/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:18.263595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.263882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.264158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.291851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] MFA Rules not processed for user `7bccd08d523c4e9b9ffa4260e54d0f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:18.293102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.384900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1048/2072] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:18.394895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.403414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.428122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88373512a9a4430cae78d0963e73b106', 'request_id': 'req-6be5f72a-a99d-4ef2-a775-5c2f5a882049'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.440139 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88373512a9a4430cae78d0963e73b106', 'request_id': 'req-6be5f72a-a99d-4ef2-a775-5c2f5a882049'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.455032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88373512a9a4430cae78d0963e73b106', 'request_id': 'req-6be5f72a-a99d-4ef2-a775-5c2f5a882049'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.478045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51191ec-e29b-4ed0-b267-c3cb1ca1f0d8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.532778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35660a-9727-4290-b446-5d6cf3680b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.533500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35660a-9727-4290-b446-5d6cf3680b96 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.533785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35660a-9727-4290-b446-5d6cf3680b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.534166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35660a-9727-4290-b446-5d6cf3680b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.604092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] The token cache is being invalidate because project 88373512a9a4430cae78d0963e73b106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:18.605170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.606955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6be5f72a-a99d-4ef2-a775-5c2f5a882049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.612041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1025/2073] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:18 2022] DELETE /identity/v3/projects/88373512a9a4430cae78d0963e73b106 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:18.614187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.614380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35660a-9727-4290-b446-5d6cf3680b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.614608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.614970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.616396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35660a-9727-4290-b446-5d6cf3680b96 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.628964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1049/2074] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:18.636031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:18.646971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.704345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1026/2075] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:18.714905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.716644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.716644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.746586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:18.748115 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.757240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1050/2076] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:18.761625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.772534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b540-34c5-4a8f-b055-fe5e5c4a66d7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.777564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.778241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.778524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.778797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.780111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:18.780453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.782090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edef3-e28a-459f-8943-a5601cf51967 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.803168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1027/2077] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:18.810654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.822065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240343d-a95d-44ad-8c46-039308838ca4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.829430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.831663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.831663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.831914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.832772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.834951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.848712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.849099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.849510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.882215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] MFA Rules not processed for user `4b92eed1018941d0b9fd6a08f276bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:18.883407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.964704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1028/2078] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:18.992208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1051/2079] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:19.004415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.016584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8857e-58bf-48dc-961f-2cc9a5011501 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.025908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.027800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.088805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.089917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.090394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.090844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.092060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.095392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.102031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c6aa-75b3-41f6-b7f7-7474c7bfbfbd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.108744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.109700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.110176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.110643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.181989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.183361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.193952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1052/2080] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:19.215393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1029/2081] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:19 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:19.219986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.232632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ce198-e76c-4b98-ac6f-ea6c19a1bb1c service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.240578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:19.248502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.248502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.248502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.248502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.249224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.253615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.282288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.282999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1053/2082] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:19.299585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a60a-373e-4502-bd25-76e67ce194a8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.312588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0f5da-7ded-4d15-8e40-49491d0b6313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.313547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0f5da-7ded-4d15-8e40-49491d0b6313 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.313985 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0f5da-7ded-4d15-8e40-49491d0b6313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.317232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0f5da-7ded-4d15-8e40-49491d0b6313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.317232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0f5da-7ded-4d15-8e40-49491d0b6313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.318556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0f5da-7ded-4d15-8e40-49491d0b6313 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.331306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1030/2083] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:19.335845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.343416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:19.349332 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c325b3-a4e6-4db6-b536-092dd8092c9d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.358293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.359285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.359580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.359864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] PATH_INFO: `/v3/projects/25a4cbb4b70843cb8619ba2977178828/users/fd234040e09b4feaad200d4ee6ad0f76/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.378144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a4cbb4b70843cb8619ba2977178828, user_id=fd234040e09b4feaad200d4ee6ad0f76, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.380974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.532394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1054/2084] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:19 2022] PUT /identity/v3/projects/25a4cbb4b70843cb8619ba2977178828/users/fd234040e09b4feaad200d4ee6ad0f76/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:19.538838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.539305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.539674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.570246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] MFA Rules not processed for user `fd234040e09b4feaad200d4ee6ad0f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:19.571571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.656009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1031/2085] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:19.660827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.734854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64022c-1f8c-4d8d-8bcd-fd52e340e5ae admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.741012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.744357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.744357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.744357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.744774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.748537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.861005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1055/2086] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:19 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:19.869974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.875404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.877367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.889562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf7f71-10b2-4290-977b-79badc7f95d4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.939966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24aefd-be2f-41be-9c40-c34b82b5863e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.943873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.944682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.944965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.945241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.947053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.952503 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.953366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.953655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.953933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.954632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.956693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.012864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.014528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.024485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1056/2087] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:20.100822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1032/2088] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:19 2022] POST /identity/v3/users => generated 309 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:20.102057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.113921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0974b-2629-48f3-a89f-1b549b526b2e service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.119479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.120161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.120483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.120770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.122061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.123777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.139569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1057/2089] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:20.140279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.151599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e4246-dcce-424f-a495-9627be3875b4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.159304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.160384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.160727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.161073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] PATH_INFO: `/v3/projects/4ee0c215125f4de1a8ba6ba6e59b2b80/users/76bf6600c9d44772968c6694a7050b55/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.178390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee0c215125f4de1a8ba6ba6e59b2b80, user_id=76bf6600c9d44772968c6694a7050b55, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.181272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.324751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1033/2090] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:20 2022] PUT /identity/v3/projects/4ee0c215125f4de1a8ba6ba6e59b2b80/users/76bf6600c9d44772968c6694a7050b55/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:20.330696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.342577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9d40-2616-4b84-8897-0f78717d9757 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.407800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba8158-8898-444d-b322-33bda1339a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.408511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba8158-8898-444d-b322-33bda1339a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.408802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba8158-8898-444d-b322-33bda1339a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.409074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba8158-8898-444d-b322-33bda1339a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.409795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba8158-8898-444d-b322-33bda1339a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.411497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba8158-8898-444d-b322-33bda1339a94 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.424490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1058/2091] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:20.428740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.450132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ff175-c3c6-4ee8-84c5-152763ba69cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.455478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.456571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.457019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.457446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] PATH_INFO: `/v3/projects/4ee0c215125f4de1a8ba6ba6e59b2b80/users/76bf6600c9d44772968c6694a7050b55/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.459808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee0c215125f4de1a8ba6ba6e59b2b80, user_id=76bf6600c9d44772968c6694a7050b55, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.462826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.481425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1034/2092] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:20 2022] PUT /identity/v3/projects/4ee0c215125f4de1a8ba6ba6e59b2b80/users/76bf6600c9d44772968c6694a7050b55/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:20.502900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.503196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.503486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.539068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] MFA Rules not processed for user `76bf6600c9d44772968c6694a7050b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:20.542234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.693986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1059/2093] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:20.714986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.770434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942178-5c51-43b7-bdf3-bcd0527cd2fb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.774075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.774697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.774981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.775260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.784286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.785742 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.795175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1035/2094] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:20.835794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.848251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c1e50-7777-45e3-9542-e5ab3b5f6147 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.852306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.853004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.853293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.853600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.855516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.930516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.932311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b39b-2d79-4610-a1d4-1dc0b9f9dbbb service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.944723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1060/2095] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:21.268994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:21.353393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7e7d-aac5-4bb9-b7d2-0263f5f3736d service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:21.359233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:21.360143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:21.360463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:21.360743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] PATH_INFO: `/v3/users/fd234040e09b4feaad200d4ee6ad0f76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:21.362000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd234040e09b4feaad200d4ee6ad0f76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:21.364064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:21.599144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd234040e09b4feaad200d4ee6ad0f76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:21.614500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:21.615305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:21.615305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:21.634588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] MFA Rules not processed for user `4b92eed1018941d0b9fd6a08f276bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:21.635942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:21.709422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1061/2096] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:21.710357 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:21.711780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:21.725900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd234040e09b4feaad200d4ee6ad0f76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:21.726579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae16c-3b73-40d1-a122-614ef014c31a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:21.726737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd234040e09b4feaad200d4ee6ad0f76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:21.733722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:21.736380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:21.737101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:21.737435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] PATH_INFO: `/v3/users/40b6873f1e484c72996bf1a949eee5c4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:21.740030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b6873f1e484c72996bf1a949eee5c4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:21.741329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd234040e09b4feaad200d4ee6ad0f76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:21.742650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-5748782f-c4b5-4380-a4a3-b2194d40b26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd234040e09b4feaad200d4ee6ad0f76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:21.743879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:21.767628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:21.777518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1036/2097] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:21 2022] DELETE /identity/v3/users/fd234040e09b4feaad200d4ee6ad0f76 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:21.782303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:21.783172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:21.783566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:21.809863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:21.811177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:21.908970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1037/2098] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:21.923550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:21.935817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:21.936230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:22.026254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94abeb-fc1e-4f03-ae34-e99ddb551163 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:22.030894 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c132b1-37fb-4ab9-abdf-31f7888dcf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:22.031672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c132b1-37fb-4ab9-abdf-31f7888dcf50 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:22.032108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c132b1-37fb-4ab9-abdf-31f7888dcf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:22.032530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c132b1-37fb-4ab9-abdf-31f7888dcf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:22.047539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c132b1-37fb-4ab9-abdf-31f7888dcf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:22.049153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c132b1-37fb-4ab9-abdf-31f7888dcf50 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:22.061721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1038/2099] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:22.148423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b6873f1e484c72996bf1a949eee5c4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:22.238457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b6873f1e484c72996bf1a949eee5c4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:22.239425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b6873f1e484c72996bf1a949eee5c4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:22.240623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b6873f1e484c72996bf1a949eee5c4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:22.273181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b6873f1e484c72996bf1a949eee5c4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:22.294914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1062/2100] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:21 2022] DELETE /identity/v3/users/40b6873f1e484c72996bf1a949eee5c4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:22.296735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:22.297038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:22.297373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:22.339804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:22.344349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:22.524892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1039/2101] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:22.540434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:22.544982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:22.635335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ba862-09f0-4879-a1cd-0b9cedb44a86 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:22.642493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:22.643626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:22.644135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:22.644618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:22.661481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:22.664292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:22.682828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1063/2102] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:22.770159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:22.771729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:22.819179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f1d1-856c-4849-a998-8eba20d4a3f4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:22.829896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:22.831479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:22.832607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:22.833492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] PATH_INFO: `/v3/projects/25a4cbb4b70843cb8619ba2977178828` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:22.848709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a4cbb4b70843cb8619ba2977178828)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:22.850666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:22.885893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:23.032198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a4cbb4b70843cb8619ba2977178828', 'request_id': 'req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.043378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a4cbb4b70843cb8619ba2977178828', 'request_id': 'req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.052485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a4cbb4b70843cb8619ba2977178828', 'request_id': 'req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.157009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] The token cache is being invalidate because project 25a4cbb4b70843cb8619ba2977178828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:23.157283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.160783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.163554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1040/2103] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:22 2022] DELETE /identity/v3/projects/25a4cbb4b70843cb8619ba2977178828 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:23.167570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:23.188902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58548463-7cd7-4324-ab93-8d50394dee1a service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:23.296425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:23.300567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:23.306102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:23.306800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] PATH_INFO: `/v3/users/76bf6600c9d44772968c6694a7050b55` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:23.310789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bf6600c9d44772968c6694a7050b55)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:23.314823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:23.460306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:23.461901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:23.484192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1aa1a-f8d2-44fb-bcc5-aef081d82350 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:23.492551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:23.493467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:23.493765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:23.494042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] PATH_INFO: `/v3/projects/cbb6a6ab1b184113ae560972671b733a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:23.495518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb6a6ab1b184113ae560972671b733a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:23.498202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:23.566399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bf6600c9d44772968c6694a7050b55'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.680097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb6a6ab1b184113ae560972671b733a', 'request_id': 'req-f288b883-cedc-4e08-976a-aabde895aa6a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.687275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb6a6ab1b184113ae560972671b733a', 'request_id': 'req-f288b883-cedc-4e08-976a-aabde895aa6a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.695733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bf6600c9d44772968c6694a7050b55'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.696638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb6a6ab1b184113ae560972671b733a', 'request_id': 'req-f288b883-cedc-4e08-976a-aabde895aa6a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.700566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:23.702954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bf6600c9d44772968c6694a7050b55'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.702954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bf6600c9d44772968c6694a7050b55'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.721220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bf6600c9d44772968c6694a7050b55'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.737689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1064/2104] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:23 2022] DELETE /identity/v3/users/76bf6600c9d44772968c6694a7050b55 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:23.794687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] The token cache is being invalidate because project cbb6a6ab1b184113ae560972671b733a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:23.795310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.796577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:23.799314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1041/2105] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:23 2022] DELETE /identity/v3/projects/cbb6a6ab1b184113ae560972671b733a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:23.804143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:23.806731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:23.894227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080edfc-0a36-461f-8433-d766e84153fc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:23.900278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:23.901208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:23.901489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:23.902368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] PATH_INFO: `/v3/users/eb8c1dda3e9c4b55a49ffd586df70bf6` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:23.903616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8c1dda3e9c4b55a49ffd586df70bf6)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:23.906296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:24.169177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8c1dda3e9c4b55a49ffd586df70bf6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.275175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8c1dda3e9c4b55a49ffd586df70bf6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.276649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8c1dda3e9c4b55a49ffd586df70bf6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.278009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8c1dda3e9c4b55a49ffd586df70bf6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.297261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e40ec998-fb49-4a28-b5cb-f28ea20af382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8c1dda3e9c4b55a49ffd586df70bf6'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.313223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1065/2106] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:23 2022] DELETE /identity/v3/users/eb8c1dda3e9c4b55a49ffd586df70bf6 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:24.342623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:24.343984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:24.496876 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288b883-cedc-4e08-976a-aabde895aa6a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:24.587837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:24.588760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:24.589046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:24.589324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] PATH_INFO: `/v3/projects/4ee0c215125f4de1a8ba6ba6e59b2b80` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:24.590657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee0c215125f4de1a8ba6ba6e59b2b80)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:24.593204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:24.752183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee0c215125f4de1a8ba6ba6e59b2b80', 'request_id': 'req-e855fb0b-e07e-4843-b101-5529f77c423e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.758092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee0c215125f4de1a8ba6ba6e59b2b80', 'request_id': 'req-e855fb0b-e07e-4843-b101-5529f77c423e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.766311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee0c215125f4de1a8ba6ba6e59b2b80', 'request_id': 'req-e855fb0b-e07e-4843-b101-5529f77c423e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.933697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] The token cache is being invalidate because project 4ee0c215125f4de1a8ba6ba6e59b2b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:24.933976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.934669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:24.941373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1042/2107] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:24 2022] DELETE /identity/v3/projects/4ee0c215125f4de1a8ba6ba6e59b2b80 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:24.942076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1bf4a-b541-42e8-9f0e-cf973bcf8b2d None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:24.942776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1bf4a-b541-42e8-9f0e-cf973bcf8b2d None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:24.942776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1bf4a-b541-42e8-9f0e-cf973bcf8b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:24.973619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:24.975536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:24.981509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b6d1bf4a-b541-42e8-9f0e-cf973bcf8b2d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:24.982968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b6d1bf4a-b541-42e8-9f0e-cf973bcf8b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:25.074783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855fb0b-e07e-4843-b101-5529f77c423e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.076371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1066/2108] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:25.081601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.082498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.082784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.083069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] PATH_INFO: `/v3/projects/3b9a777e0c904eeba2e473b3daf7fd8a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.083457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.083973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.084350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.084678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9a777e0c904eeba2e473b3daf7fd8a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.086635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.103534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:25.104807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:25.114262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1067/2109] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:25.119095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.129180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42647f60-807d-4ddf-ae60-b678d9e783f2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.134558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.135724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.136227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.136793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.138279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:25.138675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.141742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.155094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1068/2110] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:25.159604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.173314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282c8b-4d00-4d00-b291-7cbab38e3198 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.179485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.180520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.180812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.181114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.185654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.185909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:25.185998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.207205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9a777e0c904eeba2e473b3daf7fd8a', 'request_id': 'req-084733ba-4b04-417b-825e-fab03c0ca1b5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:25.216079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9a777e0c904eeba2e473b3daf7fd8a', 'request_id': 'req-084733ba-4b04-417b-825e-fab03c0ca1b5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:25.226597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9a777e0c904eeba2e473b3daf7fd8a', 'request_id': 'req-084733ba-4b04-417b-825e-fab03c0ca1b5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:25.269175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:25.339915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1069/2111] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:25.346623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.360564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] The token cache is being invalidate because project 3b9a777e0c904eeba2e473b3daf7fd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:25.360917 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:25.361736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-084733ba-4b04-417b-825e-fab03c0ca1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:25.363733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1043/2112] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:24 2022] DELETE /identity/v3/projects/3b9a777e0c904eeba2e473b3daf7fd8a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:25.371113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b76ae-cf3b-4bf7-8b05-2ac05262316b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.371640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b76ae-cf3b-4bf7-8b05-2ac05262316b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.372055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b76ae-cf3b-4bf7-8b05-2ac05262316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.396194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9e8b76ae-cf3b-4bf7-8b05-2ac05262316b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:25.397639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9e8b76ae-cf3b-4bf7-8b05-2ac05262316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:25.495729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1044/2113] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:25.507222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.508152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.512023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.541671 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1889e-0c7e-4238-bd13-ec97cdf4a867 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.545074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:25.546588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:25.558228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.563706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.563706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.563706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.563706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.565955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.570890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1045/2114] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:25.578256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.612674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f27544-c3bb-454c-a7f0-703b55157856 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.622846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.623583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.623907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.624258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.625315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:25.625634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.627310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.648694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1046/2115] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:25.649968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.661879 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184cf6-8335-4d62-9208-c40fcc8f473d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.667470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.668155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.668660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.668839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.669693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.672663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.690654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1070/2116] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/users => generated 286 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:25.696723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.701443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:25.724994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b42db-37fb-4164-9e4b-124dfb8cb42a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.731006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.733433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.733722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.734005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.734769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.736534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.749485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1071/2117] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:25.755202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.782887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11b9c5-ceb1-4d34-9eed-41d45db595f3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.791616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.793097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.793620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.794821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.796542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.799457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.817621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1072/2118] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:25.821999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.840855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88269-9a42-47a6-b764-d1ac8a228b7c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.846826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1047/2119] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:25.851135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:25.934514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d6a6f-ce31-46ce-b2d9-3b7d2c21902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.935445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d6a6f-ce31-46ce-b2d9-3b7d2c21902f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.935723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d6a6f-ce31-46ce-b2d9-3b7d2c21902f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.936039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d6a6f-ce31-46ce-b2d9-3b7d2c21902f admin admin] PATH_INFO: `/v3/projects/3a8e90eebec84acbbbf902c93e2328b8/users/54ff323c2513416eba65f71182885216/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.954039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d6a6f-ce31-46ce-b2d9-3b7d2c21902f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8e90eebec84acbbbf902c93e2328b8, user_id=54ff323c2513416eba65f71182885216, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.957621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d6a6f-ce31-46ce-b2d9-3b7d2c21902f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:25.978948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65210fc-2c1a-4860-be7b-2f6d85656b66 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:25.986828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:25.991955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:25.991955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:25.991955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:25.991955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:25.995240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.107775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1073/2120] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:25 2022] PUT /identity/v3/projects/3a8e90eebec84acbbbf902c93e2328b8/users/54ff323c2513416eba65f71182885216/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:26.110366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.110684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.111044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.155962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] MFA Rules not processed for user `54ff323c2513416eba65f71182885216`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:26.157313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:26.186639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1048/2121] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:25 2022] POST /identity/v3/users => generated 292 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:26.188756 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.208869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484fc0a-e549-4ca1-9d15-f0706cbff066 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.316912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1074/2122] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:26.319382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.334791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.335830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.336204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.336745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.337792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.342377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.351057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1049/2123] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:26.355923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.369384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3f1a9-08ca-4117-af16-d3c2470240aa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.376271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.377107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.377391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.377725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.378437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.380442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.392925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1050/2124] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:26.398172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.413877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9959-0ea9-4527-ae91-cea0984c761c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.420766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.421726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.422023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.422304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] PATH_INFO: `/v3/projects/e5aa8e55d3cb4fbea28bb7e16796f6ee/users/bf3b69fb292940e2a89846e5776f92aa/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.426658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697c2e-925a-4493-8a5b-5326b781ac14 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.432816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075fe1-8e77-4303-8b3d-33b53bcfaba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.433501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075fe1-8e77-4303-8b3d-33b53bcfaba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.433788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075fe1-8e77-4303-8b3d-33b53bcfaba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.434117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075fe1-8e77-4303-8b3d-33b53bcfaba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.435598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075fe1-8e77-4303-8b3d-33b53bcfaba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.437718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075fe1-8e77-4303-8b3d-33b53bcfaba4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.443949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5aa8e55d3cb4fbea28bb7e16796f6ee, user_id=bf3b69fb292940e2a89846e5776f92aa, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.446771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.500123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:26.539992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1051/2125] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:26 2022] PUT /identity/v3/projects/e5aa8e55d3cb4fbea28bb7e16796f6ee/users/bf3b69fb292940e2a89846e5776f92aa/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:26.541539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.543704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:26.549049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1075/2126] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:26 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:26.559353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.560061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.560777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.611980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] MFA Rules not processed for user `bf3b69fb292940e2a89846e5776f92aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:26.613249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:26.682886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13ff14-277e-4e78-989c-75532ac2a0d7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.709412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1076/2127] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:26.710547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.793489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.795066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.796858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.797191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] PATH_INFO: `/v3/users/12181d26827744bcbcc83c6d7fcf207a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.799270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12181d26827744bcbcc83c6d7fcf207a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.801476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.802363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906a84-1e01-4683-be1f-e92dfa94e511 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.807557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.808345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.808719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.809065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.809919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.812015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:26.869057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:26.931943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1077/2128] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:26 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:26.932929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:26.935715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:26.950172 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54ba3c-8e47-4819-adb4-d3ecf6ac5f93 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:26.955638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:26.956619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:26.956849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:26.957122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] PATH_INFO: `/v3/users/24663ddf3b2c4d9ba4a8397f5d43f5e4` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:26.958389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24663ddf3b2c4d9ba4a8397f5d43f5e4)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:26.961585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.098216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12181d26827744bcbcc83c6d7fcf207a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.223531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24663ddf3b2c4d9ba4a8397f5d43f5e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.242380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12181d26827744bcbcc83c6d7fcf207a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.243186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12181d26827744bcbcc83c6d7fcf207a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.257723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12181d26827744bcbcc83c6d7fcf207a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.258490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12181d26827744bcbcc83c6d7fcf207a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.275773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1052/2129] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:26 2022] DELETE /identity/v3/users/12181d26827744bcbcc83c6d7fcf207a => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:27.276990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.279330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:27.349040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050332d-66a6-4284-8957-c2677d138be6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.352983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.353651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.353932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.354206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.357098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:27.368557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24663ddf3b2c4d9ba4a8397f5d43f5e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.369638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24663ddf3b2c4d9ba4a8397f5d43f5e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.370701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24663ddf3b2c4d9ba4a8397f5d43f5e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.393083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24663ddf3b2c4d9ba4a8397f5d43f5e4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:27.412435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1078/2130] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:26 2022] DELETE /identity/v3/users/24663ddf3b2c4d9ba4a8397f5d43f5e4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:27.413774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.418254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:27.427842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.429625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a933e9-1503-4d39-a6e5-b74fd8f5bcc5 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.435439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:27.439432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1053/2131] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:27.440922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.441531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.441531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.460707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:27.462060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:27.510000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844818d-b92a-4751-91c5-8cd9cba21509 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.515300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420453-840c-47d3-ad1e-ef653725e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.515894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420453-840c-47d3-ad1e-ef653725e15a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.516206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420453-840c-47d3-ad1e-ef653725e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.516524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420453-840c-47d3-ad1e-ef653725e15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.517258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420453-840c-47d3-ad1e-ef653725e15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.518904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420453-840c-47d3-ad1e-ef653725e15a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.530513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1079/2132] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:27.531914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.532202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.532506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.537302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1054/2133] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:27.538281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.550559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50672-654f-4830-b8dd-6a03656d51af None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.556171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.557240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.557618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.557971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] PATH_INFO: `/v3/projects/fea949581511451baf0ba35cc5698239/users/509a4204e2f34f2799aa85fd06a0d49a/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.564057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:27.566236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:27.574357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea949581511451baf0ba35cc5698239, user_id=509a4204e2f34f2799aa85fd06a0d49a, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.577178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.583933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1080/2134] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:27.583933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.583933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:27.645985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804c89e-8903-4776-9ebe-215c6c1071be None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.649666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.650319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.650605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.650887 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.660743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1055/2135] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:27 2022] PUT /identity/v3/projects/fea949581511451baf0ba35cc5698239/users/509a4204e2f34f2799aa85fd06a0d49a/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:27.661751 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.661861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.663326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.676190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1081/2136] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:27.676490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.686417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4384739-1a54-4162-bf39-7e92ea446356 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.746451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7345cf-3fc8-4a8b-ad59-157345b5b16e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.751007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3c8e5-e9cd-44d4-8047-808c37ada84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.751662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3c8e5-e9cd-44d4-8047-808c37ada84c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.751952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3c8e5-e9cd-44d4-8047-808c37ada84c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.752232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3c8e5-e9cd-44d4-8047-808c37ada84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.763546 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.767355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.767355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.767355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.767355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.767355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.774124 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3c8e5-e9cd-44d4-8047-808c37ada84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.775582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3c8e5-e9cd-44d4-8047-808c37ada84c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.781879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1082/2137] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:27.788866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:27.793195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1056/2138] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:27.801040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213bfa2-a427-46a6-b1d9-3f7130257162 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:27.806748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:27.807825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.808108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.808449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] PATH_INFO: `/v3/projects/fea949581511451baf0ba35cc5698239/users/509a4204e2f34f2799aa85fd06a0d49a/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.810538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea949581511451baf0ba35cc5698239, user_id=509a4204e2f34f2799aa85fd06a0d49a, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:27.813274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:27.824385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1083/2139] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:27 2022] PUT /identity/v3/projects/fea949581511451baf0ba35cc5698239/users/509a4204e2f34f2799aa85fd06a0d49a/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:27.835516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:27.835855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:27.836137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:27.886502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] MFA Rules not processed for user `509a4204e2f34f2799aa85fd06a0d49a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:27.888485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:28.003239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1057/2140] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:28.017881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:28.020915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:28.139042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf639f-b8ed-452c-a622-8ea4d018f58c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:28.146918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:28.147623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:28.147912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:28.148197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:28.161825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:28.163659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:28.190599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1084/2141] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:28.272167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:28.428602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:28.430402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:28.559721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba584698-7db0-4efe-91b5-48a29364f572 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:28.564278 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:28.565205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:28.565490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:28.565771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] PATH_INFO: `/v3/projects/ef164e3cf9d64db2805193589fda3737` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:28.567169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef164e3cf9d64db2805193589fda3737)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:28.569197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:28.645824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:28.670909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38ac8f-b8be-4bb9-8f9e-69ae3774bc99 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:28.675011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:28.676558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:28.676860 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:28.677142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:28.679160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:28.767242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:28.768751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:28.778814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1085/2142] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:28.779486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:28.780972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:28.788026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef164e3cf9d64db2805193589fda3737', 'request_id': 'req-1126c213-de71-48f7-b5a8-59594f550522'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:28.798046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef164e3cf9d64db2805193589fda3737', 'request_id': 'req-1126c213-de71-48f7-b5a8-59594f550522'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:28.808421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef164e3cf9d64db2805193589fda3737', 'request_id': 'req-1126c213-de71-48f7-b5a8-59594f550522'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:28.811618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75011a-d307-4232-bf8d-8d9bace8ba43 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:28.906290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:28.907155 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:28.907443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:28.907720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] PATH_INFO: `/v3/projects/561d4e8d355b40439009568d16509636` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:28.909700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=561d4e8d355b40439009568d16509636)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:28.911476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:28.934986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] The token cache is being invalidate because project ef164e3cf9d64db2805193589fda3737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:28.935783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:28.935937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:28.938222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1058/2143] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:28 2022] DELETE /identity/v3/projects/ef164e3cf9d64db2805193589fda3737 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:28.942741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:28.944449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:28.959785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c213-de71-48f7-b5a8-59594f550522 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:28.966066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:28.967737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:28.968248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:28.968801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] PATH_INFO: `/v3/users/7bccd08d523c4e9b9ffa4260e54d0f46` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:28.970999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bccd08d523c4e9b9ffa4260e54d0f46)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:28.974969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:29.124789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561d4e8d355b40439009568d16509636', 'request_id': 'req-4a828a86-6571-4188-b768-32e4d768d0bf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.234655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561d4e8d355b40439009568d16509636', 'request_id': 'req-4a828a86-6571-4188-b768-32e4d768d0bf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.244510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561d4e8d355b40439009568d16509636', 'request_id': 'req-4a828a86-6571-4188-b768-32e4d768d0bf'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.256789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bccd08d523c4e9b9ffa4260e54d0f46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.266526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] The token cache is being invalidate because project 561d4e8d355b40439009568d16509636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:29.266816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.267517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.269168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1086/2144] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:28 2022] DELETE /identity/v3/projects/561d4e8d355b40439009568d16509636 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:29.273239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:29.274885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:29.351827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828a86-6571-4188-b768-32e4d768d0bf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:29.357849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bccd08d523c4e9b9ffa4260e54d0f46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.358972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bccd08d523c4e9b9ffa4260e54d0f46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.359087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:29.359912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:29.361733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:29.362079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] PATH_INFO: `/v3/users/4babdd9cdcb5488b903c6eee16633b5d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:29.363761 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4babdd9cdcb5488b903c6eee16633b5d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:29.364297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:29.368041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:29.377438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bccd08d523c4e9b9ffa4260e54d0f46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.378203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bccd08d523c4e9b9ffa4260e54d0f46'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.422630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1059/2145] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:28 2022] DELETE /identity/v3/users/7bccd08d523c4e9b9ffa4260e54d0f46 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:29.797910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4babdd9cdcb5488b903c6eee16633b5d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.963383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4babdd9cdcb5488b903c6eee16633b5d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.964416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4babdd9cdcb5488b903c6eee16633b5d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:29.966285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4babdd9cdcb5488b903c6eee16633b5d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.006348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4babdd9cdcb5488b903c6eee16633b5d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.030034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1087/2146] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:29 2022] DELETE /identity/v3/users/4babdd9cdcb5488b903c6eee16633b5d => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:30.174598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:30.178056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:30.192704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:30.323299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23d42-7f3f-4755-84e2-c4de4fd89d4f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:30.448307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:30.455427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:30.455427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:30.455427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] PATH_INFO: `/v3/projects/a32f010fc01147079ea51d479d1c2a34` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:30.455427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32f010fc01147079ea51d479d1c2a34)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:30.455427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:30.614095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32f010fc01147079ea51d479d1c2a34', 'request_id': 'req-493f1375-04da-420a-a972-a933be4620a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.621670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32f010fc01147079ea51d479d1c2a34', 'request_id': 'req-493f1375-04da-420a-a972-a933be4620a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.631666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32f010fc01147079ea51d479d1c2a34', 'request_id': 'req-493f1375-04da-420a-a972-a933be4620a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.752422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] The token cache is being invalidate because project a32f010fc01147079ea51d479d1c2a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:30.752600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:30.753345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.753345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-493f1375-04da-420a-a972-a933be4620a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:30.753602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1060/2147] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:30 2022] DELETE /identity/v3/projects/a32f010fc01147079ea51d479d1c2a34 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:30.755328 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:30.758926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db8b1-86a6-4e10-9078-9f82a8313516 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:30.759205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db8b1-86a6-4e10-9078-9f82a8313516 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:30.759492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db8b1-86a6-4e10-9078-9f82a8313516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:30.787379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba9573-4ee3-461d-a374-61cddc15e11b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:30.802177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b88db8b1-86a6-4e10-9078-9f82a8313516 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:30.803519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b88db8b1-86a6-4e10-9078-9f82a8313516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:30.896005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1061/2148] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:30.901068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:30.901960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:30.902247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:30.902523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] PATH_INFO: `/v3/projects/dbe1d77387384700b76736f04ff4c5f7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:30.904118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe1d77387384700b76736f04ff4c5f7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:30.904254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:30.906233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:30.906826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:30.907142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:30.930854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:30.932286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:30.945263 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1062/2149] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:30.946706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:30.966739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede5337-f4a4-4e7d-a186-1573d3ceecb4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:30.973151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:30.976379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:30.976379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:30.976379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:30.976379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:30.977077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:30.978427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.004386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1063/2150] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:31.009342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.020491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1d86-0035-48b1-929b-99b5a05d5cb7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.025908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.026763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.027329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.027329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.028030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.030102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.101806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe1d77387384700b76736f04ff4c5f7', 'request_id': 'req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.175437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1064/2151] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:31 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:31.181224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.195345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe1d77387384700b76736f04ff4c5f7', 'request_id': 'req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.201736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe1d77387384700b76736f04ff4c5f7', 'request_id': 'req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.214103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] The token cache is being invalidate because project dbe1d77387384700b76736f04ff4c5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:31.214366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.215054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.219741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1088/2152] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:30 2022] DELETE /identity/v3/projects/dbe1d77387384700b76736f04ff4c5f7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:31.221431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.225342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:31.259970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaa7aa-a0c8-47f0-9e57-340d9e4d7b61 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.265440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.266055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.266341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.266626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.267327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.269352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.322293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcfb4-ae4a-40d7-83e1-46bc23021c3d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.324368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.325311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.325590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.325865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] PATH_INFO: `/v3/users/ff17992a7de74cb7871d736953082ae0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.327171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff17992a7de74cb7871d736953082ae0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.329248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.377689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1065/2153] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:31 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:31.382185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.384589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:31.399805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078298-4400-497f-88d7-f32451c73823 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.417510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.417510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.417510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.417510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.418142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.420850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.436960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1066/2154] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:31.441175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.454346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49132192-8f53-4cf8-ba60-59fbe57a0229 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.459025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.459239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.459463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.459702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.460488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.462131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.480369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1067/2155] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:31.487262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.499052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96af3d-f5fb-4335-a123-17af73f2b262 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.520736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532f2cf-967b-4b52-8359-45edb2f4d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.521754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f2cf-967b-4b52-8359-45edb2f4d0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.522038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f2cf-967b-4b52-8359-45edb2f4d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.522310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f2cf-967b-4b52-8359-45edb2f4d0a1 admin admin] PATH_INFO: `/v3/projects/ca89f603a41a484ca20ea606bd668c7b/users/fa1901c4a5964e14b6b1e58677a20150/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.543105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532f2cf-967b-4b52-8359-45edb2f4d0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca89f603a41a484ca20ea606bd668c7b, user_id=fa1901c4a5964e14b6b1e58677a20150, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.549051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532f2cf-967b-4b52-8359-45edb2f4d0a1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.632195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff17992a7de74cb7871d736953082ae0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.649980 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1068/2156] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:31 2022] PUT /identity/v3/projects/ca89f603a41a484ca20ea606bd668c7b/users/fa1901c4a5964e14b6b1e58677a20150/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:31.662382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.662738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.663024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.705116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] MFA Rules not processed for user `fa1901c4a5964e14b6b1e58677a20150`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:31.706925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:31.777432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1069/2157] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:31.782283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.834310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff17992a7de74cb7871d736953082ae0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.835111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff17992a7de74cb7871d736953082ae0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.836061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff17992a7de74cb7871d736953082ae0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.855174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bc92c-e532-4b92-9343-a074683d85ce None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:31.858869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff17992a7de74cb7871d736953082ae0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:31.860596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:31.861275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:31.861562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:31.861835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:31.862533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:31.864507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:31.884485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1089/2158] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:31 2022] DELETE /identity/v3/users/ff17992a7de74cb7871d736953082ae0 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:31.980473 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1070/2159] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:31 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:31.985605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:31.988432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.035446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:32.090286 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a734-c8eb-4cd1-8f3d-10be43fefe8d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.135010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:32.214703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.215567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.215914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.216194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.217267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.219669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.336539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1090/2160] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:31 2022] POST /identity/v3/users => generated 289 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:32.336661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.342810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93cd1-40c5-4dc2-8b55-28a68858cda4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.349878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.350620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.351107 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.351533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.352499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.354159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.366197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1071/2161] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:32.370623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.382267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f38abb-6d64-48bc-83de-f477ee399f07 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.388201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.389024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.389312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.389592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.390343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.392041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.403916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1091/2162] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:32.408861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.424123 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6ad0e-4b80-4e44-8297-311c5f52699d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.429345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a122ea-58fd-403d-969e-4b60532b993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.430449 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a122ea-58fd-403d-969e-4b60532b993f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.430740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a122ea-58fd-403d-969e-4b60532b993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.431173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a122ea-58fd-403d-969e-4b60532b993f admin admin] PATH_INFO: `/v3/projects/5a32396d4d2443ddaa67b8852913a4cb/users/6ee9dc28239f46d09a05ca7ad0d929a2/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.452512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a122ea-58fd-403d-969e-4b60532b993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a32396d4d2443ddaa67b8852913a4cb, user_id=6ee9dc28239f46d09a05ca7ad0d929a2, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.455565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a122ea-58fd-403d-969e-4b60532b993f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.489966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.492483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.512998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2152e1-d415-40b0-afd7-7333ffeed2d5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.521964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.526649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.526649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.526649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] PATH_INFO: `/v3/projects/bc60a266c90c4f5eb87085425b067aae` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.526649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc60a266c90c4f5eb87085425b067aae)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.529414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.592787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1072/2163] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:32 2022] PUT /identity/v3/projects/5a32396d4d2443ddaa67b8852913a4cb/users/6ee9dc28239f46d09a05ca7ad0d929a2/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:32.597377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.597693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.597956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.630582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] MFA Rules not processed for user `6ee9dc28239f46d09a05ca7ad0d929a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:32.632249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.705944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1073/2164] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:32.710466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.738004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc60a266c90c4f5eb87085425b067aae', 'request_id': 'req-582037bf-778f-4297-8bbf-1a7db10ce1b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.779229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65ce1b-600b-4690-a219-bc65cbd47768 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.850040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.850637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.850928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.851210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.851941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.853958 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.888731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc60a266c90c4f5eb87085425b067aae', 'request_id': 'req-582037bf-778f-4297-8bbf-1a7db10ce1b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.900586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc60a266c90c4f5eb87085425b067aae', 'request_id': 'req-582037bf-778f-4297-8bbf-1a7db10ce1b5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.915071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] The token cache is being invalidate because project bc60a266c90c4f5eb87085425b067aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:32.915504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.916208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-582037bf-778f-4297-8bbf-1a7db10ce1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.917827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1092/2165] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:32 2022] DELETE /identity/v3/projects/bc60a266c90c4f5eb87085425b067aae => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:32.923455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772cd93-3a9b-4bd2-bcba-352442b3409a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.923748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772cd93-3a9b-4bd2-bcba-352442b3409a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.924050 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772cd93-3a9b-4bd2-bcba-352442b3409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.942590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3772cd93-3a9b-4bd2-bcba-352442b3409a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:32.943677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3772cd93-3a9b-4bd2-bcba-352442b3409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.952230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1093/2166] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:32.959982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.960278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.960607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.978960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:32.982492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.989360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1094/2167] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:32.994028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.003613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b484a-c75e-4576-97ef-b35d33d69f3e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.009898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.010579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.010873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.011245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.012052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:33.012445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.014126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.034976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1074/2168] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:32 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:33.040987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.043335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:33.044901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1095/2169] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:33.050822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.068738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c5323-e2ea-4ed6-af1f-7e1cc734518b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.126392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9621c-7918-4c56-8bb3-96ca0ff39feb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.131558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.132243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.132564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.132843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.133558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.135552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.157907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.162987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.162987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.162987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.162987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.162987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.243632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1075/2170] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:33 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:33.245026 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.260007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c6b2-44bc-412a-9d41-788794fd2aee admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.265556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.266321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.266672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.267046 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.267892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.269614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.284387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1076/2171] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:33.296525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.307190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d1f-8555-4351-ae6b-b3f021797971 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.312377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.313292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.313580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.313860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] PATH_INFO: `/v3/projects/3e2ec168874344cf99accd79f6cd51b1/users/164b996faa8348f68557da05aafc7161/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.328316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1096/2172] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:33 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:33.331716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ec168874344cf99accd79f6cd51b1, user_id=164b996faa8348f68557da05aafc7161, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.334246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.334463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.399402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8fc93-b145-4106-9a0c-2227df2c2ae0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.405368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.406056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.406345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.406628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.407333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.411152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.452868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1077/2173] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:33 2022] PUT /identity/v3/projects/3e2ec168874344cf99accd79f6cd51b1/users/164b996faa8348f68557da05aafc7161/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:33.457217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.546474 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe065-23d3-420f-aa8c-c9c83254725f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.551928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.552664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.552956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.553233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.554065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.556401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.571468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1097/2174] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:33 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:33.578093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.578279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1078/2175] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:33.579217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.601162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75760b0-2942-4e5f-baca-a0636dc76a89 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.603065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.603479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3644d-2d80-4c80-8d39-185dfcb392bc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.605378 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.605703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.605998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.610751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.613421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.627857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b0385-b8c0-4996-9f27-b73beac036b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.629598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b0385-b8c0-4996-9f27-b73beac036b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.632296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b0385-b8c0-4996-9f27-b73beac036b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.632883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b0385-b8c0-4996-9f27-b73beac036b9 admin admin] PATH_INFO: `/v3/projects/3e2ec168874344cf99accd79f6cd51b1/users/164b996faa8348f68557da05aafc7161/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.633713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1098/2176] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:33.636230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b0385-b8c0-4996-9f27-b73beac036b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ec168874344cf99accd79f6cd51b1, user_id=164b996faa8348f68557da05aafc7161, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.638116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.640666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b0385-b8c0-4996-9f27-b73beac036b9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.654826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1079/2177] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:33 2022] PUT /identity/v3/projects/3e2ec168874344cf99accd79f6cd51b1/users/164b996faa8348f68557da05aafc7161/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:33.663626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2001-1207-4574-b2c7-bf859b0ef8c5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.666303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.666610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.666890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.712566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] MFA Rules not processed for user `164b996faa8348f68557da05aafc7161`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:33.713987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:33.776877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.776877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.777184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.777598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.778225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.780306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.799097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1099/2178] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:33.801036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.813170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4357-2b86-429e-838b-223a0dc6aefc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.820046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.821685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.826125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.826125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] PATH_INFO: `/v3/projects/3b37a8d8f28a4f87a0571decf4816afc/users/905f2cad8ff5493388c6a334fb42372f/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.833915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1080/2179] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:33.846530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.848119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:33.849411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b37a8d8f28a4f87a0571decf4816afc, user_id=905f2cad8ff5493388c6a334fb42372f, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.856043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.931533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69f50d-b2ad-4427-b199-d351fe513746 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.936080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9503cf6-6d18-401b-94b8-224a509dd6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.936830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9503cf6-6d18-401b-94b8-224a509dd6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.943846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9503cf6-6d18-401b-94b8-224a509dd6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.943846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9503cf6-6d18-401b-94b8-224a509dd6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.948630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9503cf6-6d18-401b-94b8-224a509dd6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.950389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9503cf6-6d18-401b-94b8-224a509dd6c3 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.961028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1081/2180] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:33.971499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1100/2181] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:33 2022] PUT /identity/v3/projects/3b37a8d8f28a4f87a0571decf4816afc/users/905f2cad8ff5493388c6a334fb42372f/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:33.976887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.977177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.977515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.997601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:33.999002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:34.083440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1082/2182] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:34.091605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:34.097089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:34.097214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:34.097333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:34.177279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638536b-b613-43df-a351-a2af2b4dc55e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:34.183219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:34.185500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:34.185500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:34.185500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:34.191232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c0a8f-fea9-4dfe-b63c-eea421db7f32 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:34.196574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:34.198302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:34.198449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:34.199169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:34.199527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:34.199880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:34.202421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:34.212728 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1083/2183] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:34.269798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:34.271263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bcb7f-08dd-4502-a234-ce515597be59 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:34.281205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1101/2184] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:34.781163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:35.219688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:35.944628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:35.946477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:35.959653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3219c7-a174-4561-9b36-a45118ab6dc7 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:35.964869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:35.965782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:35.966594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:35.966909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] PATH_INFO: `/v3/users/bf3b69fb292940e2a89846e5776f92aa` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:35.968208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3b69fb292940e2a89846e5776f92aa)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:35.970360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:36.342877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:36.344126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:36.344795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:36.367409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3b69fb292940e2a89846e5776f92aa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:36.379751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] MFA Rules not processed for user `905f2cad8ff5493388c6a334fb42372f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:36.380054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:36.458354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1102/2185] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:36.471972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:36.480516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3b69fb292940e2a89846e5776f92aa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:36.481495 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3b69fb292940e2a89846e5776f92aa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:36.498661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4d510-a4d0-4014-901b-1c1b180d8071 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:36.506300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3b69fb292940e2a89846e5776f92aa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:36.507085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3b69fb292940e2a89846e5776f92aa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:36.510627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:36.510627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:36.510627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:36.511274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:36.513849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:36.527859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:36.530416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66086928-5ac2-48c5-bed9-7b5d618c7115 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:36.542811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1103/2186] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:36.557671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1084/2187] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:35 2022] DELETE /identity/v3/users/bf3b69fb292940e2a89846e5776f92aa => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:36.562622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:36.563101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:36.563565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:36.585534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:36.591032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:36.706206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1104/2188] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:36.720487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:36.722723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:36.821280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc958c3-4758-484d-888b-a30216f985a0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:36.826419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8c522-f763-4adf-94fa-5e285a6095a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:36.826620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8c522-f763-4adf-94fa-5e285a6095a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:36.827039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8c522-f763-4adf-94fa-5e285a6095a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:36.827374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8c522-f763-4adf-94fa-5e285a6095a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:36.840723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8c522-f763-4adf-94fa-5e285a6095a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:36.842286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8c522-f763-4adf-94fa-5e285a6095a4 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:36.853374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1085/2189] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:37.337098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:37.339416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:37.352610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7604cf-7456-486d-b3bb-64e980ea4068 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:37.361160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:37.361843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:37.362132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:37.362407 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] PATH_INFO: `/v3/projects/e5aa8e55d3cb4fbea28bb7e16796f6ee` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:37.363980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5aa8e55d3cb4fbea28bb7e16796f6ee)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:37.381200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:37.545936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5aa8e55d3cb4fbea28bb7e16796f6ee', 'request_id': 'req-467a1992-db81-4441-b2d5-f7db1d2890b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:37.637456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5aa8e55d3cb4fbea28bb7e16796f6ee', 'request_id': 'req-467a1992-db81-4441-b2d5-f7db1d2890b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:37.645489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5aa8e55d3cb4fbea28bb7e16796f6ee', 'request_id': 'req-467a1992-db81-4441-b2d5-f7db1d2890b1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:37.657238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] The token cache is being invalidate because project e5aa8e55d3cb4fbea28bb7e16796f6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:37.657565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:37.658231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-467a1992-db81-4441-b2d5-f7db1d2890b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:37.659791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1105/2190] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:37 2022] DELETE /identity/v3/projects/e5aa8e55d3cb4fbea28bb7e16796f6ee => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:37.666519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:37.671133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:37.671541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:37.694284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:37.695577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:37.763288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1086/2191] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:37.771105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:37.771408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:37.771693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:37.793319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:37.795554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:37.805276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1106/2192] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:37.810720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:37.822267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1233202-fd6f-4672-8817-2015de8bcbb5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:37.827622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:37.830336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:37.830336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:37.830336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:37.830336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:37.830336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:37.831549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:37.857362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1087/2193] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:37.868294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:37.881651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d2976-b9e5-4991-98d1-cc5644fc8d86 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:37.889267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:37.890158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:37.896509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:37.896509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:37.896509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:37.896509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:38.025483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1107/2194] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:37 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:38.027642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:38.047376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06faeb7-11ec-437a-aef9-bf37bcf08ccd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:38.131366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:38.132087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.132772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.132772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.133594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:38.135460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:38.269883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1088/2195] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:38 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:38.274350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:38.285654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b636b-86bb-4eaa-9a08-8b86c91b20d4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:38.290715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:38.291399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.291686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.291992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.292751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:38.294413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:38.307644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1108/2196] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:38.312067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:38.323152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff96b8-a360-48fb-82bd-20799bc9275a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:38.330020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b73f5-1bb4-45b1-849a-8c5654995bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:38.330736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b73f5-1bb4-45b1-849a-8c5654995bca admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.331017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b73f5-1bb4-45b1-849a-8c5654995bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.331292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b73f5-1bb4-45b1-849a-8c5654995bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.332048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b73f5-1bb4-45b1-849a-8c5654995bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:38.333799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b73f5-1bb4-45b1-849a-8c5654995bca admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:38.345238 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1089/2197] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:38.349450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:38.359803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e441-ef27-4867-b740-f3482eb09bf7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:38.364712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e38d-c19e-4464-96c7-07abe4d5ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:38.365610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e38d-c19e-4464-96c7-07abe4d5ad0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.365891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e38d-c19e-4464-96c7-07abe4d5ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.366163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e38d-c19e-4464-96c7-07abe4d5ad0a admin admin] PATH_INFO: `/v3/projects/c3a5a8147b764c22b9c4037c7b8f5a6b/users/48b5ab6a0c0440d380ad0b16722f60e7/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.385742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e38d-c19e-4464-96c7-07abe4d5ad0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a5a8147b764c22b9c4037c7b8f5a6b, user_id=48b5ab6a0c0440d380ad0b16722f60e7, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:38.390459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e38d-c19e-4464-96c7-07abe4d5ad0a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:38.514462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1109/2198] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:38 2022] PUT /identity/v3/projects/c3a5a8147b764c22b9c4037c7b8f5a6b/users/48b5ab6a0c0440d380ad0b16722f60e7/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:38.520162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.520523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.520813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.543402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:38.545273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:38.546102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.547318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.547621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.591198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] MFA Rules not processed for user `905f2cad8ff5493388c6a334fb42372f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:38.592697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:38.629927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1090/2199] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:38.642641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:38.644543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:38.689264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1110/2200] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:38.740023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133f4a3-364c-4b4c-a8cd-c32a13e5c8bf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:38.747584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5a09e-c3e8-4451-9d60-a9ecc641a00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:38.750237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a09e-c3e8-4451-9d60-a9ecc641a00d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:38.751098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a09e-c3e8-4451-9d60-a9ecc641a00d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:38.751803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a09e-c3e8-4451-9d60-a9ecc641a00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:38.781092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5a09e-c3e8-4451-9d60-a9ecc641a00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:38.783179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5a09e-c3e8-4451-9d60-a9ecc641a00d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:38.809465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1091/2201] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:38.976079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:39.309142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:39.373792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:39.377440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:39.413128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261e675-966f-4f3f-b1fb-135801ca90d8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:39.421618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:39.423195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:39.423722 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:39.424246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] PATH_INFO: `/v3/users/fa1901c4a5964e14b6b1e58677a20150` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:39.426471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1901c4a5964e14b6b1e58677a20150)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:39.430617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:39.691432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1901c4a5964e14b6b1e58677a20150'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:39.826114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1901c4a5964e14b6b1e58677a20150'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:39.826754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1901c4a5964e14b6b1e58677a20150'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:39.827568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1901c4a5964e14b6b1e58677a20150'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:39.850202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1901c4a5964e14b6b1e58677a20150'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:39.882825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1111/2202] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:39 2022] DELETE /identity/v3/users/fa1901c4a5964e14b6b1e58677a20150 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:39.883799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:39.883799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:39.884549 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:39.931809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:39.934293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:40.056203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1092/2203] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:40.068059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:40.069624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:40.150574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d692-d9b3-4095-9548-c65ff0ec10ed admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:40.156162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:40.156905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:40.157189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:40.157505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:40.170830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:40.172387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:40.183723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1112/2204] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:40.937069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:40.939294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:40.953455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34eab3-55ba-46e8-98a0-6de35fee3150 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:40.959858 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:40.960821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:40.961070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:40.961347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] PATH_INFO: `/v3/projects/ca89f603a41a484ca20ea606bd668c7b` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:40.962777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca89f603a41a484ca20ea606bd668c7b)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:40.966140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:41.185612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca89f603a41a484ca20ea606bd668c7b', 'request_id': 'req-9bf847b1-8a77-4e5a-9783-43ec54c6541d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:41.193192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca89f603a41a484ca20ea606bd668c7b', 'request_id': 'req-9bf847b1-8a77-4e5a-9783-43ec54c6541d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:41.200271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca89f603a41a484ca20ea606bd668c7b', 'request_id': 'req-9bf847b1-8a77-4e5a-9783-43ec54c6541d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:41.321153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] The token cache is being invalidate because project ca89f603a41a484ca20ea606bd668c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:41.324630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:41.324630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:41.324630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1093/2205] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:40 2022] DELETE /identity/v3/projects/ca89f603a41a484ca20ea606bd668c7b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:41.329218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:41.341121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5af18-2229-4adc-818e-872c650e0647 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:41.412569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:41.413520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:41.413775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:41.414059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] PATH_INFO: `/v3/users/6ee9dc28239f46d09a05ca7ad0d929a2` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:41.415715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee9dc28239f46d09a05ca7ad0d929a2)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:41.417816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:41.454156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:41.763235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee9dc28239f46d09a05ca7ad0d929a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:42.011858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee9dc28239f46d09a05ca7ad0d929a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:42.012714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee9dc28239f46d09a05ca7ad0d929a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:42.016359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee9dc28239f46d09a05ca7ad0d929a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:42.033768 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee9dc28239f46d09a05ca7ad0d929a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:42.056563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1113/2206] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:41 2022] DELETE /identity/v3/users/6ee9dc28239f46d09a05ca7ad0d929a2 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:42.432823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:42.806832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:42.808475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:42.862830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf847b1-8a77-4e5a-9783-43ec54c6541d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:43.008377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:43.011140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:43.011511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:43.012316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] PATH_INFO: `/v3/projects/5a32396d4d2443ddaa67b8852913a4cb` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:43.014221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a32396d4d2443ddaa67b8852913a4cb)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:43.016930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:43.264138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a32396d4d2443ddaa67b8852913a4cb', 'request_id': 'req-0df1f2c0-9e10-4900-ad97-c4e320627569'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.269664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a32396d4d2443ddaa67b8852913a4cb', 'request_id': 'req-0df1f2c0-9e10-4900-ad97-c4e320627569'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.275975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a32396d4d2443ddaa67b8852913a4cb', 'request_id': 'req-0df1f2c0-9e10-4900-ad97-c4e320627569'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.369165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] The token cache is being invalidate because project 5a32396d4d2443ddaa67b8852913a4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:43.369556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.370351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.375567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1094/2207] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:42 2022] DELETE /identity/v3/projects/5a32396d4d2443ddaa67b8852913a4cb => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:43.380951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:43.382696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:43.397781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f0811-eb22-4f1d-a180-d518b8133cda admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:43.460822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:43.514595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:43.516212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:43.516832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:43.517285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] PATH_INFO: `/v3/users/164b996faa8348f68557da05aafc7161` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:43.521380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=164b996faa8348f68557da05aafc7161)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:43.521380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:43.846986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164b996faa8348f68557da05aafc7161'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.938244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164b996faa8348f68557da05aafc7161'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.938921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164b996faa8348f68557da05aafc7161'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.941413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164b996faa8348f68557da05aafc7161'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.971732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35369408-b22a-4e9c-b092-d1493abdc2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164b996faa8348f68557da05aafc7161'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:43.999840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1114/2208] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:43 2022] DELETE /identity/v3/users/164b996faa8348f68557da05aafc7161 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:44.358383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:45.049967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:45.051794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:45.093919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1f2c0-9e10-4900-ad97-c4e320627569 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:45.247795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:45.363089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:45.366733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.367232 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.367735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] PATH_INFO: `/v3/projects/3e2ec168874344cf99accd79f6cd51b1` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.373418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2ec168874344cf99accd79f6cd51b1)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:45.378297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:45.535743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2ec168874344cf99accd79f6cd51b1', 'request_id': 'req-ed8727da-da45-42c5-842d-f4faae095a59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:45.543668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2ec168874344cf99accd79f6cd51b1', 'request_id': 'req-ed8727da-da45-42c5-842d-f4faae095a59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:45.554504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2ec168874344cf99accd79f6cd51b1', 'request_id': 'req-ed8727da-da45-42c5-842d-f4faae095a59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:45.683824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] The token cache is being invalidate because project 3e2ec168874344cf99accd79f6cd51b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:45.684146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:45.684783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ed8727da-da45-42c5-842d-f4faae095a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:45.688784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1095/2209] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:45 2022] DELETE /identity/v3/projects/3e2ec168874344cf99accd79f6cd51b1 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:45.693257 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.693745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.693822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.726620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:45.726620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:45.889135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1115/2210] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:45.900655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.901002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.901216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.936292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:45.939057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:45.966221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1096/2211] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:45.967067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:45.997676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f08f-bde3-46a4-82b9-175f472b6465 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.029947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.030683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.031012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.031287 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.034411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:46.034654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.038289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.068489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1116/2212] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:38:46.071868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.093741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206087ab-ce2b-45e8-afa1-8b29bd0ab441 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.103394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.104807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.105398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.105899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.107406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.112372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.254675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1097/2213] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:46.262537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.314619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f36c1-68c1-4cbb-a289-de2b6d8d81f4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.398391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:46.465843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.465843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.465843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.465843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.466327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.466327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.631265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1117/2214] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:46.632645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.646611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d8070-9d4d-4f1b-935f-0b453f93d8b9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.653445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.654213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.654591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.654932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.656301 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.659841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.680208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1098/2215] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:46.682675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.702839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38c78e-440b-4391-818a-bcd4dd71c4ca admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.723271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f5610-b355-4a05-9c8d-f1227c958106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.725081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f5610-b355-4a05-9c8d-f1227c958106 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.725354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f5610-b355-4a05-9c8d-f1227c958106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.725633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f5610-b355-4a05-9c8d-f1227c958106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.727529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f5610-b355-4a05-9c8d-f1227c958106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.729522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f5610-b355-4a05-9c8d-f1227c958106 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.758379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1118/2216] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:46.761017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.780252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26bd9-9481-4738-86da-584ab6069265 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.790197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.792939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.793779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.800404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] PATH_INFO: `/v3/projects/c81eb76e30ea44e4b21648162115a745/users/48a8802dc3c34cd1bb6584c888c482a2/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.830822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81eb76e30ea44e4b21648162115a745, user_id=48a8802dc3c34cd1bb6584c888c482a2, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.834722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.939530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1099/2217] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:46 2022] PUT /identity/v3/projects/c81eb76e30ea44e4b21648162115a745/users/48a8802dc3c34cd1bb6584c888c482a2/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:46.952058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.952908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.953183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.983404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] MFA Rules not processed for user `48a8802dc3c34cd1bb6584c888c482a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.984702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:47.090667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1119/2218] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:47.096069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.209129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500474a-b7ad-4ea4-97ba-eebb8919ac1e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.227408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.227408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.227408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.227408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.227937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.229279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.376378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1100/2219] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.379567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.397382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bdb76-d85c-4838-a585-c627f90ca568 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.560088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.560908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.561197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.561470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.562728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.571039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.676033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1120/2220] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.687501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.703505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a4d2-91e8-4c1f-9e13-26e3d77f470f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.712312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.713161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.718316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.718316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.718316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.718316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.738133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1101/2221] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.742189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.761417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fbd17-414c-48e9-929d-50f9c1ec2616 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.767951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.769003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.769354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.769704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] PATH_INFO: `/v3/projects/d7e0374d28c24e6bb674824e1b930828/users/586d31cf1c9043a886252b7e79660614/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.789008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e0374d28c24e6bb674824e1b930828, user_id=586d31cf1c9043a886252b7e79660614, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.793405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.905461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1121/2222] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:47 2022] PUT /identity/v3/projects/d7e0374d28c24e6bb674824e1b930828/users/586d31cf1c9043a886252b7e79660614/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:47.910370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.929749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51f7fd-5e8b-4732-b3d0-d2c81240dc92 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.042541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b9e9-e21e-44ea-8f9c-b3f59cf59132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.043799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b9e9-e21e-44ea-8f9c-b3f59cf59132 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.044208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b9e9-e21e-44ea-8f9c-b3f59cf59132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.044652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b9e9-e21e-44ea-8f9c-b3f59cf59132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.047642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8b9e9-e21e-44ea-8f9c-b3f59cf59132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.048692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8b9e9-e21e-44ea-8f9c-b3f59cf59132 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.086721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1102/2223] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.088140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.108091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c426e-faa1-4df1-9f83-e671bfab4b47 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.119952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.120988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.122311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.122440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] PATH_INFO: `/v3/projects/d7e0374d28c24e6bb674824e1b930828/users/586d31cf1c9043a886252b7e79660614/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.125052 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e0374d28c24e6bb674824e1b930828, user_id=586d31cf1c9043a886252b7e79660614, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.125502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.130499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.149129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1122/2224] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/d7e0374d28c24e6bb674824e1b930828/users/586d31cf1c9043a886252b7e79660614/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:48.161234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab96c-32a3-4b52-9c09-552a05726a21 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.161831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab96c-32a3-4b52-9c09-552a05726a21 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.162293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab96c-32a3-4b52-9c09-552a05726a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.195662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-931ab96c-32a3-4b52-9c09-552a05726a21 None None] MFA Rules not processed for user `586d31cf1c9043a886252b7e79660614`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.197229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-931ab96c-32a3-4b52-9c09-552a05726a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.335968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1103/2225] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:48.350249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.353504 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.508555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb8c52-876a-4502-bfe6-00225bc4a37e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.513265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.514199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.514486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.514778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.531247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.533070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.545813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1123/2226] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:49.296749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.658088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.658088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.658088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.690942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] MFA Rules not processed for user `48b5ab6a0c0440d380ad0b16722f60e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:49.692567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.799499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1104/2227] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.806402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.808236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.939579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305172-8fe6-4ec6-a801-5304acabec97 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.945416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.946533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.947026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.947544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.948627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.951806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.057862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1124/2228] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:50.058165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.077038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c53443-4810-4412-a1b4-56da4dc35082 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.141996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.142827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.143180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.143523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.144286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.146370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.308890 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1105/2229] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:50 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:50.311972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.325914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d907de-3fba-4f98-83bb-0a78c69bb952 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.334223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.334941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.335230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.335513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.336298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.337991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.361902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1125/2230] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:50.366005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.378919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ac2f-6bd1-4874-963a-173c66d0d695 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.383822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.384856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.385212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.385567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] PATH_INFO: `/v3/projects/c40193da35b84b52b358238c6f847dc4/users/3c46f6351c71417cb68aaae7813082e0/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.406513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40193da35b84b52b358238c6f847dc4, user_id=3c46f6351c71417cb68aaae7813082e0, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.410317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.450207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.460869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56894bc-d0a4-486d-81a3-d113eb3adae7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.465846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.466747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.467030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.467308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] PATH_INFO: `/v3/users/48a8802dc3c34cd1bb6584c888c482a2` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.469460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a8802dc3c34cd1bb6584c888c482a2)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.471428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.519206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1106/2231] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:50 2022] PUT /identity/v3/projects/c40193da35b84b52b358238c6f847dc4/users/3c46f6351c71417cb68aaae7813082e0/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:50.522994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.589793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb418b7-c08a-4272-b0c7-fb0dc0847956 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.597037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.597984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.598371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.603569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.603569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.603569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.614349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1107/2232] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:50.618365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.630619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580629e-af63-42f5-a3d8-ed8548085149 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.636426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5773a5-471d-4dee-bc2e-9ac8d166b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.637536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5773a5-471d-4dee-bc2e-9ac8d166b4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.637923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5773a5-471d-4dee-bc2e-9ac8d166b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.638424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5773a5-471d-4dee-bc2e-9ac8d166b4f5 admin admin] PATH_INFO: `/v3/projects/c40193da35b84b52b358238c6f847dc4/users/3c46f6351c71417cb68aaae7813082e0/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.641511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5773a5-471d-4dee-bc2e-9ac8d166b4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40193da35b84b52b358238c6f847dc4, user_id=3c46f6351c71417cb68aaae7813082e0, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.646089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5773a5-471d-4dee-bc2e-9ac8d166b4f5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.669239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1108/2233] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:50 2022] PUT /identity/v3/projects/c40193da35b84b52b358238c6f847dc4/users/3c46f6351c71417cb68aaae7813082e0/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:50.705359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a8802dc3c34cd1bb6584c888c482a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:50.800045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a8802dc3c34cd1bb6584c888c482a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:50.801484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a8802dc3c34cd1bb6584c888c482a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:50.805980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a8802dc3c34cd1bb6584c888c482a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:50.834352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a8802dc3c34cd1bb6584c888c482a2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:50.875206 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1126/2234] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:50 2022] DELETE /identity/v3/users/48a8802dc3c34cd1bb6584c888c482a2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:50.876647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.876942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.877224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.901952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:50.902269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:50.999196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1109/2235] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:51.013266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:51.014848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:51.159423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c50c62-648b-47a2-8577-1a0b6921648d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:51.167064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:51.167868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:51.168832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:51.169315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:51.169892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:51.184978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:51.186640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:51.199107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1127/2236] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:51.551425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:52.022299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:52.023874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:52.039203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7896a-7e49-4251-b5e8-b9bda3d1f1e9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:52.080920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:52.082069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.082502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.082925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] PATH_INFO: `/v3/projects/c81eb76e30ea44e4b21648162115a745` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.084307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81eb76e30ea44e4b21648162115a745)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:52.086733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:52.293998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81eb76e30ea44e4b21648162115a745', 'request_id': 'req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.321480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81eb76e30ea44e4b21648162115a745', 'request_id': 'req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.334403 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81eb76e30ea44e4b21648162115a745', 'request_id': 'req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.494752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] The token cache is being invalidate because project c81eb76e30ea44e4b21648162115a745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:52.498181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.498181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.498181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1110/2237] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:52 2022] DELETE /identity/v3/projects/c81eb76e30ea44e4b21648162115a745 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:52.501461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:52.512177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36914a7-84c0-4c9b-84ca-4440f6b83ecf service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:52.619937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:52.620973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.621260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.621539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] PATH_INFO: `/v3/users/586d31cf1c9043a886252b7e79660614` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.623046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586d31cf1c9043a886252b7e79660614)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:52.630116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:52.851034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586d31cf1c9043a886252b7e79660614'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.853671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:52.951427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586d31cf1c9043a886252b7e79660614'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.958148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586d31cf1c9043a886252b7e79660614'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.960175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586d31cf1c9043a886252b7e79660614'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.007772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-99a71c8c-6410-49f1-9af1-e97ccc357994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586d31cf1c9043a886252b7e79660614'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.041808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1128/2238] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:52 2022] DELETE /identity/v3/users/586d31cf1c9043a886252b7e79660614 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:53.680198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:53.682346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:53.698043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1efe2f-dda1-4288-ada8-bbd1f9eb9b36 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:53.793627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:53.794669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:53.795004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:53.795321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] PATH_INFO: `/v3/projects/d7e0374d28c24e6bb674824e1b930828` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:53.796921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e0374d28c24e6bb674824e1b930828)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:53.800020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:53.989309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e0374d28c24e6bb674824e1b930828', 'request_id': 'req-8024786e-d24b-4a58-beb8-996066f50081'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.007379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e0374d28c24e6bb674824e1b930828', 'request_id': 'req-8024786e-d24b-4a58-beb8-996066f50081'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.018747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e0374d28c24e6bb674824e1b930828', 'request_id': 'req-8024786e-d24b-4a58-beb8-996066f50081'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.187299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] The token cache is being invalidate because project d7e0374d28c24e6bb674824e1b930828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:54.187912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.189610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-8024786e-d24b-4a58-beb8-996066f50081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.191565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1111/2239] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:53 2022] DELETE /identity/v3/projects/d7e0374d28c24e6bb674824e1b930828 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:54.197822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.198350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.199320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.263774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:54.267663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.394482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1129/2240] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:54.403408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32547-1584-4340-a556-5d154a57b637 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.403707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32547-1584-4340-a556-5d154a57b637 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.403995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32547-1584-4340-a556-5d154a57b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.442277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-52a32547-1584-4340-a556-5d154a57b637 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:54.443509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52a32547-1584-4340-a556-5d154a57b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.453646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1112/2241] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:54.459607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.480896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe018be-755a-4434-ae0c-080e42c519c1 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.480896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.480896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.480896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.481900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.481900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:54.482136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.484644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.499289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1130/2242] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:54.508765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32547-1584-4340-a556-5d154a57b637 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.520073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32547-1584-4340-a556-5d154a57b637 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.525764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.526804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.527939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.532340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.533432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.535656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.636042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1113/2243] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:54.640685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.654818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9515-f99e-4eaa-99bd-e448ea0de446 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.744032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.745212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.745590 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.746197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.747535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.751390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.878811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1131/2244] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/users => generated 281 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:54.883833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.898036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9a2f-5936-47e7-a2da-fb5d0e0e151b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.903605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.904606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.905103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.905586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.907514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.910652 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.928535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1114/2245] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:54.933477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.947419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7ebc-413e-47bb-a50e-b0b6bc6da999 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.970557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad420848-8f12-42fb-a622-86dfea219379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.971323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420848-8f12-42fb-a622-86dfea219379 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.971611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420848-8f12-42fb-a622-86dfea219379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.971953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420848-8f12-42fb-a622-86dfea219379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.972905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad420848-8f12-42fb-a622-86dfea219379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.975242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad420848-8f12-42fb-a622-86dfea219379 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.987559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1132/2246] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:54.992237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.013594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14d93-286d-4a74-8347-1779c0dc8201 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.019557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.020702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.020991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.021547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] PATH_INFO: `/v3/projects/3056c3829db14ad7bdca79d75e8d9d64/users/c11e0434a8004b8d8c45e34aa1fe38d2/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.042197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3056c3829db14ad7bdca79d75e8d9d64, user_id=c11e0434a8004b8d8c45e34aa1fe38d2, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.046893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.207375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1115/2247] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:54 2022] PUT /identity/v3/projects/3056c3829db14ad7bdca79d75e8d9d64/users/c11e0434a8004b8d8c45e34aa1fe38d2/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:55.209168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.209625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.209820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.256932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] MFA Rules not processed for user `c11e0434a8004b8d8c45e34aa1fe38d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:55.259198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:55.355820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1133/2248] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:55.399070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.400888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:55.497317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042a49-2bff-4a8e-97f4-1471a4d3a18b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.502128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f581689-76e4-4349-97fd-7e526a2de687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.503150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581689-76e4-4349-97fd-7e526a2de687 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.503589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581689-76e4-4349-97fd-7e526a2de687 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.504029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581689-76e4-4349-97fd-7e526a2de687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.514857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f581689-76e4-4349-97fd-7e526a2de687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.517339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f581689-76e4-4349-97fd-7e526a2de687 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.529818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1116/2249] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:55.547269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.638484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a24d7-e6a9-439a-9a8f-9e4f8d263716 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.644305 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.645250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.646837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.646837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] PATH_INFO: `/v3/users/c11e0434a8004b8d8c45e34aa1fe38d2` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.647953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11e0434a8004b8d8c45e34aa1fe38d2)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.650141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.949186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11e0434a8004b8d8c45e34aa1fe38d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:56.082884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11e0434a8004b8d8c45e34aa1fe38d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:56.083554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11e0434a8004b8d8c45e34aa1fe38d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:56.084195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11e0434a8004b8d8c45e34aa1fe38d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:56.108271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11e0434a8004b8d8c45e34aa1fe38d2'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:56.133246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1134/2250] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:38:55 2022] DELETE /identity/v3/users/c11e0434a8004b8d8c45e34aa1fe38d2 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:56.144010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:56.144885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:56.145314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:56.189518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:56.192012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:56.418784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1117/2251] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:56.430566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:56.432661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:56.521615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2ace-2bf6-4928-95e3-1153306f3e74 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:56.526119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdfe6a-7b48-4421-8ab4-ca23e6b1ddaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:56.527723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdfe6a-7b48-4421-8ab4-ca23e6b1ddaa service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:56.528183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdfe6a-7b48-4421-8ab4-ca23e6b1ddaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:56.528786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdfe6a-7b48-4421-8ab4-ca23e6b1ddaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:56.552128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdfe6a-7b48-4421-8ab4-ca23e6b1ddaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:56.568700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdfe6a-7b48-4421-8ab4-ca23e6b1ddaa service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:56.585959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1135/2252] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:56.632911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:57.259316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.262113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:57.280308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513fa56-c0e3-4cce-be80-d5a2f8d0f0f1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.286635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.287824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.288355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.288840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] PATH_INFO: `/v3/projects/3056c3829db14ad7bdca79d75e8d9d64` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.291915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3056c3829db14ad7bdca79d75e8d9d64)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.295545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:57.449738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3056c3829db14ad7bdca79d75e8d9d64', 'request_id': 'req-7d63b220-34f8-47c5-9c93-378f334d5ebe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:57.465527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3056c3829db14ad7bdca79d75e8d9d64', 'request_id': 'req-7d63b220-34f8-47c5-9c93-378f334d5ebe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:57.477346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3056c3829db14ad7bdca79d75e8d9d64', 'request_id': 'req-7d63b220-34f8-47c5-9c93-378f334d5ebe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:57.548482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] The token cache is being invalidate because project 3056c3829db14ad7bdca79d75e8d9d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:57.551222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:57.552768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7d63b220-34f8-47c5-9c93-378f334d5ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:57.559648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1118/2253] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:38:57 2022] DELETE /identity/v3/projects/3056c3829db14ad7bdca79d75e8d9d64 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:57.567178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.567640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.567778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.578720 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:57.600574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:57.602112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:57.702239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1136/2254] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:57.711210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.711575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.711942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.742153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:57.743614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:57.765519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1119/2255] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:57.770144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.807466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19594afc-76ee-4c96-9cfc-8a90249e27d7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.837320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.838046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.838334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.838603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.848811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:57.850491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.864342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:57.915747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1137/2256] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:57.916672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.931791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ffc3-cb82-4a8a-acec-62f81b4bfc84 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.944713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.945391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.945686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.945947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.946641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.949984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:58.140519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1120/2257] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:38:57 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:58.144695 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:58.161106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e653eb-453d-4cd9-bf7e-02d0b24201aa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:58.275617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:58.278138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:58.278615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:58.278923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:58.280017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:58.282197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:58.442095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1138/2258] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:38:58 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:58.450481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:58.497557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f22b1-b240-41c5-8d0b-ecff7bb4fb76 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:58.505053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:58.506253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:58.506830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:58.508666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:58.509709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:58.513085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:58.534239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1121/2259] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:58.535099 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:58.553011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50cc06-9d9e-4899-b99f-ccf4dcd9527b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:58.560315 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ae05-30e5-4990-b505-ebebe6fceeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:58.561045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ae05-30e5-4990-b505-ebebe6fceeef admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:58.561454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ae05-30e5-4990-b505-ebebe6fceeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:58.561865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ae05-30e5-4990-b505-ebebe6fceeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:58.562604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ae05-30e5-4990-b505-ebebe6fceeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:58.564272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ae05-30e5-4990-b505-ebebe6fceeef admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:58.575438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1139/2260] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:58.581165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:58.610354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ec0d-c94c-4195-aaaa-a5dcdd6cbab1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:58.623102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4912d50-36a9-4d32-9fab-dc7d6641aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:58.624673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4912d50-36a9-4d32-9fab-dc7d6641aadc admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:58.625371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4912d50-36a9-4d32-9fab-dc7d6641aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:58.626112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4912d50-36a9-4d32-9fab-dc7d6641aadc admin admin] PATH_INFO: `/v3/projects/044a5c7d76544f2c83d8fcb66fb77326/users/abb4b4fd68714092a2f2ec4a769f3a5e/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:58.666483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4912d50-36a9-4d32-9fab-dc7d6641aadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=044a5c7d76544f2c83d8fcb66fb77326, user_id=abb4b4fd68714092a2f2ec4a769f3a5e, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:58.670618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4912d50-36a9-4d32-9fab-dc7d6641aadc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:59.142649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1122/2261] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:38:58 2022] PUT /identity/v3/projects/044a5c7d76544f2c83d8fcb66fb77326/users/abb4b4fd68714092a2f2ec4a769f3a5e/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:59.229379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:59.230041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:59.230496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:59.271360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] MFA Rules not processed for user `abb4b4fd68714092a2f2ec4a769f3a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:59.273854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:59.350901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1140/2262] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:59.352655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187ca7-a559-4f08-bc21-d6ede5bb82e3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:59.353092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187ca7-a559-4f08-bc21-d6ede5bb82e3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:59.353376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187ca7-a559-4f08-bc21-d6ede5bb82e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:59.367322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:59.367322 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:59.560863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-49187ca7-a559-4f08-bc21-d6ede5bb82e3 None None] MFA Rules not processed for user `3c46f6351c71417cb68aaae7813082e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:59.562163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-49187ca7-a559-4f08-bc21-d6ede5bb82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:59.581485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afa98-6ba1-4eb0-a8f6-5d3e34955d1c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:59.586308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:59.587124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:59.587662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:59.588120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:59.598487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:59.599877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:59.611921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1141/2263] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:59.660965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1123/2264] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:59.683100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:59.686872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:59.784874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640ccdb-7c27-44bb-97e1-867cac440156 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:59.788690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:59.789337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:59.789625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:59.789991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:59.791831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:59.865229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:59.866693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:59.882840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1142/2265] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:38:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:00.197170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.197532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.197821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.231037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:00.232545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:00.337040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1124/2266] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:00.393013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:00.394712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:00.503479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c297c3-3be5-4423-be66-2fc0c8abe4ec service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:00.513825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3582c4-5126-4699-8409-b0c87d6115d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:00.514629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3582c4-5126-4699-8409-b0c87d6115d9 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.515297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3582c4-5126-4699-8409-b0c87d6115d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.515482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3582c4-5126-4699-8409-b0c87d6115d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.532662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3582c4-5126-4699-8409-b0c87d6115d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:00.537969 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3582c4-5126-4699-8409-b0c87d6115d9 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:00.556174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1143/2267] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:39:02.125130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:02.735812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:04.558852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:04.997242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:05.979211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:07.129349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:07.309893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10a875-ce81-4d81-8ffe-e943296df59c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:07.319802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:07.323794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.324298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.324609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] PATH_INFO: `/v3/users/abb4b4fd68714092a2f2ec4a769f3a5e` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:07.329388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb4b4fd68714092a2f2ec4a769f3a5e)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:07.331948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:07.388716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:07.655297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb4b4fd68714092a2f2ec4a769f3a5e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.736557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb4b4fd68714092a2f2ec4a769f3a5e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.739575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb4b4fd68714092a2f2ec4a769f3a5e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.785285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb4b4fd68714092a2f2ec4a769f3a5e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.789172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb4b4fd68714092a2f2ec4a769f3a5e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.821093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1125/2268] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:07 2022] DELETE /identity/v3/users/abb4b4fd68714092a2f2ec4a769f3a5e => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:07.821281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba29f6-0b6e-4e8a-8bc2-7c8fb7034786 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.821281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba29f6-0b6e-4e8a-8bc2-7c8fb7034786 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.821281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba29f6-0b6e-4e8a-8bc2-7c8fb7034786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:07.911514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-92ba29f6-0b6e-4e8a-8bc2-7c8fb7034786 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:07.913059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-92ba29f6-0b6e-4e8a-8bc2-7c8fb7034786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:08.021847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1144/2269] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:08.033333 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:08.035790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:08.147696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb43f8-979a-4e69-b7d8-c6331c7c601f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:08.167185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:08.168825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:08.169406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:08.170025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.197055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:08.199487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:08.216573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1126/2270] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:08.667496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc290-b361-4630-be22-1c950363dbf0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:08.668049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc290-b361-4630-be22-1c950363dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:08.668049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fc290-b361-4630-be22-1c950363dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.707129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ad9fc290-b361-4630-be22-1c950363dbf0 None None] MFA Rules not processed for user `905f2cad8ff5493388c6a334fb42372f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:08.708973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ad9fc290-b361-4630-be22-1c950363dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:08.805199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1145/2271] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:08.994411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:08.995941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:09.019580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf3e1-371f-488d-b127-1a860a8655eb service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:09.043522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:09.048040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:09.050472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:09.052525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] PATH_INFO: `/v3/projects/044a5c7d76544f2c83d8fcb66fb77326` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:09.061919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044a5c7d76544f2c83d8fcb66fb77326)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:09.065227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:09.296694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044a5c7d76544f2c83d8fcb66fb77326', 'request_id': 'req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:09.317804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044a5c7d76544f2c83d8fcb66fb77326', 'request_id': 'req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:09.329112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044a5c7d76544f2c83d8fcb66fb77326', 'request_id': 'req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:09.455012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] The token cache is being invalidate because project 044a5c7d76544f2c83d8fcb66fb77326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:09.455679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:09.457613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:09.461122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1127/2272] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:08 2022] DELETE /identity/v3/projects/044a5c7d76544f2c83d8fcb66fb77326 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:09.479259 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:09.974369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac3f9e-7b24-4477-bdba-47957832ee00 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:09.974948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac3f9e-7b24-4477-bdba-47957832ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:09.974948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac3f9e-7b24-4477-bdba-47957832ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:09.994143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-16ac3f9e-7b24-4477-bdba-47957832ee00 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:09.995397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-16ac3f9e-7b24-4477-bdba-47957832ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:10.069442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1146/2273] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:10.091434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:10.092960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:10.203577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28dfe3c-2e71-4f48-b8b1-968cf9f1d6c8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:10.216435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33fbe3-955e-4842-9a3f-ca68cb37f4fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:10.217404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33fbe3-955e-4842-9a3f-ca68cb37f4fb service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:10.217749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33fbe3-955e-4842-9a3f-ca68cb37f4fb service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:10.218035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33fbe3-955e-4842-9a3f-ca68cb37f4fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:10.227800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33fbe3-955e-4842-9a3f-ca68cb37f4fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:10.229385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33fbe3-955e-4842-9a3f-ca68cb37f4fb service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:10.239866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1128/2274] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:10.984513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:10.986140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:10.988095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.026763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] MFA Rules not processed for user `82bf01c0cdbc48fa9b78933314039ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:11.029490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:11.129746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1147/2275] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:11.419718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:12.188955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:13.757974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:15.137948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:16.006672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db57c4-adaa-45b4-8bae-4d7613adca04 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:16.006976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db57c4-adaa-45b4-8bae-4d7613adca04 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:16.007564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db57c4-adaa-45b4-8bae-4d7613adca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.027562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b4db57c4-adaa-45b4-8bae-4d7613adca04 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:16.028713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b4db57c4-adaa-45b4-8bae-4d7613adca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:16.037375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1129/2276] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:16.053436 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:16.055120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:16.087176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f059f5-6851-47c9-a496-b1b53c4ecac2 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:16.093550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:16.094335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:16.094819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:16.095344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.100617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336cf1-75f6-460d-901d-32d12c9f46f7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:16.101070 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336cf1-75f6-460d-901d-32d12c9f46f7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:16.101330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336cf1-75f6-460d-901d-32d12c9f46f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.112897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:16.115001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:16.126570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1148/2277] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:16.175745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-16336cf1-75f6-460d-901d-32d12c9f46f7 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:16.177591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-16336cf1-75f6-460d-901d-32d12c9f46f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:16.299920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1130/2278] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:39:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:16.316071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:16.318259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:16.513196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22186f-1a94-49d8-b0c4-5ebaa5300807 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:16.520997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:16.522126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:16.522631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:16.523061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.536691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:16.538765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:16.549609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1149/2279] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:39:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:39:16.903281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:17.210368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef0260-e48f-4c4b-bcb5-00442096e9d7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:17.211241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef0260-e48f-4c4b-bcb5-00442096e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:17.211673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef0260-e48f-4c4b-bcb5-00442096e9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:17.238156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-50ef0260-e48f-4c4b-bcb5-00442096e9d7 None None] MFA Rules not processed for user `48b5ab6a0c0440d380ad0b16722f60e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:17.240874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-50ef0260-e48f-4c4b-bcb5-00442096e9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:17.320734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1131/2280] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:19.298201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.930615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.488960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.492239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.514067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2de69-e664-4bb7-bef4-a6afbf98f3d9 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.522538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.525763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.526381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.526985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] PATH_INFO: `/v3/users/54ff323c2513416eba65f71182885216` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.529564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ff323c2513416eba65f71182885216)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.533719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.595650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.826018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ff323c2513416eba65f71182885216'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:22.830486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.831337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.831754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.870500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:22.872057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.881715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1132/2281] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:22.904120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.918830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1113c7-04f6-4564-8045-edbbd5c2c5ed None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.926158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ff323c2513416eba65f71182885216'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:22.927220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ff323c2513416eba65f71182885216'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:22.928854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ff323c2513416eba65f71182885216'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:22.935324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.940525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.940525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.940525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.940525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.969672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.971655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ff323c2513416eba65f71182885216'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:22.975996 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a859c1c-2a65-433b-9b92-412154ef05f9 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.009859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1133/2282] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:23.028557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1150/2283] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:22 2022] DELETE /identity/v3/users/54ff323c2513416eba65f71182885216 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:23.031776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.032923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.033753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.065357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:23.068424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.162712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1134/2284] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:23.177027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.179274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.227478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.269816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78069abb-f18a-4716-86ad-87320143bcce admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.277233 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.277907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.278189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.278474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.294955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.308732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.308950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1151/2285] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:24.167110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:24.168700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:24.202606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5506-68fc-43cb-9c1e-8455d5910936 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:24.237386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:24.238755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:24.238755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:24.239096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] PATH_INFO: `/v3/projects/3a8e90eebec84acbbbf902c93e2328b8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:24.245587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8e90eebec84acbbbf902c93e2328b8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:24.251062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:24.447408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8e90eebec84acbbbf902c93e2328b8', 'request_id': 'req-f66d6752-309d-4726-9b9a-ff60b907ff1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:24.454757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8e90eebec84acbbbf902c93e2328b8', 'request_id': 'req-f66d6752-309d-4726-9b9a-ff60b907ff1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:24.465063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8e90eebec84acbbbf902c93e2328b8', 'request_id': 'req-f66d6752-309d-4726-9b9a-ff60b907ff1c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:24.549316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] The token cache is being invalidate because project 3a8e90eebec84acbbbf902c93e2328b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:24.549645 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:24.550351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:24.556929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1135/2286] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:24 2022] DELETE /identity/v3/projects/3a8e90eebec84acbbbf902c93e2328b8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:24.561110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:24.571744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afad82-dc59-4fd5-a709-c5e28728b9bc service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:24.702954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:24.703903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:24.704186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:24.704490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] PATH_INFO: `/v3/users/509a4204e2f34f2799aa85fd06a0d49a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:24.706079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] RBAC: Authorizing `identity:delete_user(user_id=509a4204e2f34f2799aa85fd06a0d49a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:24.708831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:24.853165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:24.935150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509a4204e2f34f2799aa85fd06a0d49a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:24.937533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:25.035555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509a4204e2f34f2799aa85fd06a0d49a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.036805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509a4204e2f34f2799aa85fd06a0d49a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.038300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509a4204e2f34f2799aa85fd06a0d49a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.060924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ca4a44d0-e48d-437c-b852-1851f96d271a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509a4204e2f34f2799aa85fd06a0d49a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.080081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1152/2287] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:24 2022] DELETE /identity/v3/users/509a4204e2f34f2799aa85fd06a0d49a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:25.985485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:25.988513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:26.019556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d6752-309d-4726-9b9a-ff60b907ff1c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:26.221747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:26.223316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.223815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.224465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] PATH_INFO: `/v3/projects/fea949581511451baf0ba35cc5698239` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.227246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea949581511451baf0ba35cc5698239)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:26.229726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:26.418096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea949581511451baf0ba35cc5698239', 'request_id': 'req-65f152b0-138c-42c8-ad58-8348b3290350'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.432577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea949581511451baf0ba35cc5698239', 'request_id': 'req-65f152b0-138c-42c8-ad58-8348b3290350'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.450245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea949581511451baf0ba35cc5698239', 'request_id': 'req-65f152b0-138c-42c8-ad58-8348b3290350'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.593458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] The token cache is being invalidate because project fea949581511451baf0ba35cc5698239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:26.593839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.594952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-65f152b0-138c-42c8-ad58-8348b3290350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.596825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1136/2288] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:25 2022] DELETE /identity/v3/projects/fea949581511451baf0ba35cc5698239 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:26.602647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.603245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.604780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.676468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:26.681604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:26.820009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1153/2289] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:26.831760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.832048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.832355 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.854042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:26.855410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:26.888201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:26.888761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1137/2290] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:26.906473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85ef24-4437-4192-a7b2-16996d8f01c0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:26.918744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:26.921059 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.922241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.922537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.924496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:26.925058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:26.927175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:26.946649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1154/2291] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:26.952797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:26.964904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4de66-f5d0-4b2d-a051-c66eaac4cf7f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:26.972169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:26.972816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.972952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.973526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.974619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:26.983017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.125146 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1138/2292] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:39:26 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:27.129330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:27.144597 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3251e1-5d68-4f60-bbbe-45a22c20dcf7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:27.245988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:27.246691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.247018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.247383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.248523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:27.250947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.380242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1155/2293] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:39:27 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:27.385126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:27.411752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338598-2ea0-44e1-b6fa-909582084bbc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:27.434317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:27.438708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.438997 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.440269 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.442938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:27.446057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.482113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1139/2294] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:27.485629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:27.500659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6406f3b-2879-47ec-8464-9f7b7d9f9bb3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:27.514224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091269-873e-4a2d-9046-5dcfd110a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:27.515329 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091269-873e-4a2d-9046-5dcfd110a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.515776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091269-873e-4a2d-9046-5dcfd110a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.518552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091269-873e-4a2d-9046-5dcfd110a9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.518552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6091269-873e-4a2d-9046-5dcfd110a9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:27.520764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6091269-873e-4a2d-9046-5dcfd110a9d4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.554981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:27.555219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1156/2295] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:27.565998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef3ce-6b32-4f8f-a568-cd5a81e5adfc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:27.574988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:27.575922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.576210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.576546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] PATH_INFO: `/v3/projects/960e8e3a096d48a7ad6d4238b98c1826/users/46afa0eb221943b89981682c29254324/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.621202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=960e8e3a096d48a7ad6d4238b98c1826, user_id=46afa0eb221943b89981682c29254324, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:27.624295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.730695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1140/2296] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:27 2022] PUT /identity/v3/projects/960e8e3a096d48a7ad6d4238b98c1826/users/46afa0eb221943b89981682c29254324/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:27.732533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.732996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.733103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.791647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] MFA Rules not processed for user `46afa0eb221943b89981682c29254324`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:27.793053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:27.917498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1157/2297] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:27.919092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.027874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305fe4c-15b1-4928-85d4-897c7b91f8fb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.033412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.034148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.034442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.034724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.035631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.037764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.124912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1141/2298] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:39:27 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:28.129384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.155762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40952c2d-5bab-40ea-89ef-086c5d325b82 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.234129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.235336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.237042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.237163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:28.237921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.239041 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.241974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.378760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1158/2299] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:28.383908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.398507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:28.407302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3001dd-671b-4364-b02a-1eeea2213233 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.411693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a0dc-3c8e-4155-a7f4-a346009f0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.412634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a0dc-3c8e-4155-a7f4-a346009f0e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.413654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a0dc-3c8e-4155-a7f4-a346009f0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.414170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a0dc-3c8e-4155-a7f4-a346009f0e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.415160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a0dc-3c8e-4155-a7f4-a346009f0e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.417455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a0dc-3c8e-4155-a7f4-a346009f0e25 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.444926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1142/2300] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:28.446083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.476276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e70f3-564e-463c-85aa-a36da5cf7f61 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.491434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.491434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.491434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.491434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] PATH_INFO: `/v3/projects/6d0df9c6fde64fe1bf6af7b67e9acfb9/users/1ce29c9a15ad43e49155eec0d466ca93/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.494135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.494601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.494979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.542496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:28.559919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.560131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0df9c6fde64fe1bf6af7b67e9acfb9, user_id=1ce29c9a15ad43e49155eec0d466ca93, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.561458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.682164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1159/2301] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:28 2022] PUT /identity/v3/projects/6d0df9c6fde64fe1bf6af7b67e9acfb9/users/1ce29c9a15ad43e49155eec0d466ca93/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:28.686658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.700546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1143/2302] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:28.735445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.758106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.880079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5e62-d2c4-48dc-94f5-db0e2d0c72f2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.896011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b19a2-91a9-4836-81e6-b74290b912b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.897225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b19a2-91a9-4836-81e6-b74290b912b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.897750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b19a2-91a9-4836-81e6-b74290b912b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.898401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b19a2-91a9-4836-81e6-b74290b912b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.900430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b19a2-91a9-4836-81e6-b74290b912b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.903867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b19a2-91a9-4836-81e6-b74290b912b2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.934007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1160/2303] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:28.935443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.935732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.936008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.961609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:28.962878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.968734 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1febf0-2a6c-445a-b7eb-c3eac0c4aa34 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.978404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1161/2304] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:28.982479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.009701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f607176-3741-4e4e-8546-e7d55c2fd7b5 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.025384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8fb4-f600-40a9-a615-b0a5165fb16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.026762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8fb4-f600-40a9-a615-b0a5165fb16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.027274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8fb4-f600-40a9-a615-b0a5165fb16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.031319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8fb4-f600-40a9-a615-b0a5165fb16e admin admin] PATH_INFO: `/v3/projects/6d0df9c6fde64fe1bf6af7b67e9acfb9/users/1ce29c9a15ad43e49155eec0d466ca93/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.036989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e8fb4-f600-40a9-a615-b0a5165fb16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0df9c6fde64fe1bf6af7b67e9acfb9, user_id=1ce29c9a15ad43e49155eec0d466ca93, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.044355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e8fb4-f600-40a9-a615-b0a5165fb16e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.062050 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.063390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.063900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.064586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.077301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1162/2305] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:28 2022] PUT /identity/v3/projects/6d0df9c6fde64fe1bf6af7b67e9acfb9/users/1ce29c9a15ad43e49155eec0d466ca93/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:29.088409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.088732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.089015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.158861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] MFA Rules not processed for user `1ce29c9a15ad43e49155eec0d466ca93`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:29.161003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.275082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.276782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.296173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1144/2306] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:39:29.298236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.305682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.418276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d440-f7b7-4753-9dce-782476dc5885 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.438591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1163/2307] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:29.469077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.478717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.515092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.515924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.516274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.516651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.658730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.658730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.694607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1145/2308] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:29.699259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6bbe0-04e8-4ca7-a130-340c62b26364 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.710976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.715259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.716728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.718858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.007375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.011607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.051201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1164/2309] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:32.459701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.583846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:33.416256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:33.418312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:33.436688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c238f6-fc22-4d94-82f8-b88569f27f4d service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:33.445808 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad84ab-d7b9-442e-b42c-49f499962716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:33.446500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad84ab-d7b9-442e-b42c-49f499962716 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.446805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad84ab-d7b9-442e-b42c-49f499962716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.447071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad84ab-d7b9-442e-b42c-49f499962716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.463168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad84ab-d7b9-442e-b42c-49f499962716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:33.464750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad84ab-d7b9-442e-b42c-49f499962716 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:33.478439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1146/2310] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:35.414811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:36.281683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:37.071895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.459761 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.479021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d3f83-224f-456f-888e-aa8ba8aa82f6 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.487784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.488870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.489246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.489593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] PATH_INFO: `/v3/users/46afa0eb221943b89981682c29254324` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.491093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46afa0eb221943b89981682c29254324)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.493928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.711204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.872437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46afa0eb221943b89981682c29254324'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:39.054397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46afa0eb221943b89981682c29254324'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:39.055066 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46afa0eb221943b89981682c29254324'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:39.055674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46afa0eb221943b89981682c29254324'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:39.071849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46afa0eb221943b89981682c29254324'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:39.099764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1165/2311] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:38 2022] DELETE /identity/v3/users/46afa0eb221943b89981682c29254324 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:39.106408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.120856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.120856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.128463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:39.129725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:39.230035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1147/2312] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:39.243853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.245922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:39.287699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:39.340379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676801-5d08-432f-9673-74522b90ea4c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.353259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.353953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.354251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.354528 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.366110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.369703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.384523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1166/2313] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:39.409499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:39.719011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:40.019351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:40.022620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:40.035072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495e7b-22b4-400a-836c-0994f5c3841c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:40.057514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:40.058089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:40.058379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:40.058664 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] PATH_INFO: `/v3/projects/960e8e3a096d48a7ad6d4238b98c1826` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.059925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=960e8e3a096d48a7ad6d4238b98c1826)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:40.062049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:40.174552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960e8e3a096d48a7ad6d4238b98c1826', 'request_id': 'req-d76526c5-4c46-428c-9173-2c6287b7d94d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.181248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960e8e3a096d48a7ad6d4238b98c1826', 'request_id': 'req-d76526c5-4c46-428c-9173-2c6287b7d94d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.189345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960e8e3a096d48a7ad6d4238b98c1826', 'request_id': 'req-d76526c5-4c46-428c-9173-2c6287b7d94d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.310401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] The token cache is being invalidate because project 960e8e3a096d48a7ad6d4238b98c1826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:40.310777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.311709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.313646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1148/2314] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:40 2022] DELETE /identity/v3/projects/960e8e3a096d48a7ad6d4238b98c1826 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:40.317935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:40.319777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:40.329337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7651-dcef-43b3-a044-39ce7008cdf6 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:40.407586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:40.408526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:40.408815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:40.409098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] PATH_INFO: `/v3/users/1ce29c9a15ad43e49155eec0d466ca93` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.417177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce29c9a15ad43e49155eec0d466ca93)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:40.421377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:40.636105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:40.646655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce29c9a15ad43e49155eec0d466ca93'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.740380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce29c9a15ad43e49155eec0d466ca93'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.741091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce29c9a15ad43e49155eec0d466ca93'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.741710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce29c9a15ad43e49155eec0d466ca93'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.765443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3aacae69-a3b3-4239-8e25-f446ec9c0e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce29c9a15ad43e49155eec0d466ca93'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.782402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1167/2315] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:40 2022] DELETE /identity/v3/users/1ce29c9a15ad43e49155eec0d466ca93 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:40.926712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:41.316577 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.318422 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:41.342769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76526c5-4c46-428c-9173-2c6287b7d94d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.401242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:41.448376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.459122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.459122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.459122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] PATH_INFO: `/v3/projects/6d0df9c6fde64fe1bf6af7b67e9acfb9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.459122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0df9c6fde64fe1bf6af7b67e9acfb9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.459122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.505190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:41.605696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0df9c6fde64fe1bf6af7b67e9acfb9', 'request_id': 'req-04d5c614-ba31-4148-80dc-2dbdac4d9b85'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.619900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0df9c6fde64fe1bf6af7b67e9acfb9', 'request_id': 'req-04d5c614-ba31-4148-80dc-2dbdac4d9b85'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.636630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0df9c6fde64fe1bf6af7b67e9acfb9', 'request_id': 'req-04d5c614-ba31-4148-80dc-2dbdac4d9b85'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.755998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] The token cache is being invalidate because project 6d0df9c6fde64fe1bf6af7b67e9acfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:41.756427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.759651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-04d5c614-ba31-4148-80dc-2dbdac4d9b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.761672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1149/2316] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:41 2022] DELETE /identity/v3/projects/6d0df9c6fde64fe1bf6af7b67e9acfb9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:41.767380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.767915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.768627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.791355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:41.793763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:41.870863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1168/2317] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:41.880395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.880687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.880984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.901425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:41.902693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:41.911330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1150/2318] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:41.915896 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.925929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25049d3d-dc60-4652-9a1c-ba342367861b None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.931807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.932541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.932826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.933103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.933837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:41.934149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.935846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.948919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1169/2319] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:41.953703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.964125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7970b3-a270-4e44-ba5b-c5a94fa1af39 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.972828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.973946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.974242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.974524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.975230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.978009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.014908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.086095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1151/2320] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:42.090579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.107161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ca87-3963-40c5-ba6e-84908a26d376 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.165295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.172908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.172908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.172908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.172908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.173512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.173880 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.333989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1170/2321] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:42.339994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.350863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c355-51c2-4fda-9317-9b3cb77ece86 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.356371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.357034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.357317 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.357612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.358368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.360079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.371517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1152/2322] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:42.375459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.385953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a8298-cd5f-414e-9591-b47b77978ef4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.390782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89262b-a87e-47a8-9db0-a4763ecb4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.396977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89262b-a87e-47a8-9db0-a4763ecb4979 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.396977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89262b-a87e-47a8-9db0-a4763ecb4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.396977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89262b-a87e-47a8-9db0-a4763ecb4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.396977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89262b-a87e-47a8-9db0-a4763ecb4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.396977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89262b-a87e-47a8-9db0-a4763ecb4979 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.405447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1171/2323] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:42.409744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.420478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dea224-2023-4e39-8b0e-c64c7b5e8e20 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.425116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.426039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.426323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.426596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] PATH_INFO: `/v3/projects/f873be694ac942fdbbf608f4ca6e2217/users/67674cb7b079435791d6908ce4929900/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.442400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f873be694ac942fdbbf608f4ca6e2217, user_id=67674cb7b079435791d6908ce4929900, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.445085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.472180 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.538337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.547078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1153/2324] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:42 2022] PUT /identity/v3/projects/f873be694ac942fdbbf608f4ca6e2217/users/67674cb7b079435791d6908ce4929900/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:42.558885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.559089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.559364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.591558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] MFA Rules not processed for user `67674cb7b079435791d6908ce4929900`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:42.592828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:42.669404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1172/2325] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:42.673956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.685351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.707031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.742321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8cf9e-96fb-43fc-bd16-9749a2f4601d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.747478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.748162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.748482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.748767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.749492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.752103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.835805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1154/2326] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:42.839271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.851002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32b83-689c-431a-a33c-9f0a57b3c46a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.932463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.933637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.934132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.934637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.935937 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.939704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.964585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:43.172769 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1173/2327] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/users => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:43.176748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.188826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066897-7719-45a0-9103-d703e15537e3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.193813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.194511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.194781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.195093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.196539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.198696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.209280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1155/2328] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:43.213761 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.243024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892010c-8e70-4a6e-9447-1bd756403755 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.250214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.251112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.251396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.251920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] PATH_INFO: `/v3/projects/0cf2b11f6e244508bd4f4f697d2ec3a1/users/51854fcc2cb048cf92ea095fe6604852/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.269280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf2b11f6e244508bd4f4f697d2ec3a1, user_id=51854fcc2cb048cf92ea095fe6604852, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.272065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.384632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1174/2329] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:43 2022] PUT /identity/v3/projects/0cf2b11f6e244508bd4f4f697d2ec3a1/users/51854fcc2cb048cf92ea095fe6604852/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:43.389511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.401480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00435-1fe0-4dec-80d1-128f121406b8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.467420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c7ee8-8b6a-4fb6-ac09-f7d534799f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.468608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7ee8-8b6a-4fb6-ac09-f7d534799f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.468889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7ee8-8b6a-4fb6-ac09-f7d534799f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.469157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7ee8-8b6a-4fb6-ac09-f7d534799f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.470074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c7ee8-8b6a-4fb6-ac09-f7d534799f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.471784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c7ee8-8b6a-4fb6-ac09-f7d534799f45 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.483935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1156/2330] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:43.488040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.499548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244ec1-2c16-4fe7-bcd1-c6eff2525fec admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.506314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.507223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.507505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.507780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] PATH_INFO: `/v3/projects/0cf2b11f6e244508bd4f4f697d2ec3a1/users/51854fcc2cb048cf92ea095fe6604852/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.509863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf2b11f6e244508bd4f4f697d2ec3a1, user_id=51854fcc2cb048cf92ea095fe6604852, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.512835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.524313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1175/2331] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:43 2022] PUT /identity/v3/projects/0cf2b11f6e244508bd4f4f697d2ec3a1/users/51854fcc2cb048cf92ea095fe6604852/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:43.534861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.535233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.535509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.547061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:43.565562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] MFA Rules not processed for user `51854fcc2cb048cf92ea095fe6604852`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:43.566978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:43.634289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:43.648211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1157/2332] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:43.666833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.666833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:43.752082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e4e5-7f21-49b6-a699-12a0204f603a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.759921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57af6-4f5c-42f3-abb0-2cfefcc87ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.760824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57af6-4f5c-42f3-abb0-2cfefcc87ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.761109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57af6-4f5c-42f3-abb0-2cfefcc87ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.761461 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57af6-4f5c-42f3-abb0-2cfefcc87ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.771837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b57af6-4f5c-42f3-abb0-2cfefcc87ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.773333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b57af6-4f5c-42f3-abb0-2cfefcc87ef4 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.785373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1176/2333] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:43.841485 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.843110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:43.855310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566236f-5ef0-4e97-b1b2-7fa8cdc39f6f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.859452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.860031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.860312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.860786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.926500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.927993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.938689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1158/2334] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:44.184183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:44.425251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:45.387380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:45.728524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:46.465288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:46.559778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:46.992826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:46.993976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:46.993976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:47.022799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:47.024615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:47.097747 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1177/2335] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:47.126706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:47.130357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:47.277753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ae758-aa8e-417d-81cf-11e429e0a939 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:47.284648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:47.285548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:47.285988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:47.286431 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:47.296776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:47.299119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:47.313547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1159/2336] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:47.413190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:47.530252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.196089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.298946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.408213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.410072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.517855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c790a-f860-4b0f-9fb4-ece36c13f686 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.523235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.523901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.524197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.524632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.526467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.538595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.538769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.540363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9740a6-04cb-469e-a279-57b739f67592 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.551011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1178/2337] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:48.719248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.762221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.122391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.557413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.567013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab7d0e-33cf-45ab-b997-76a69851caed service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.570688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.574352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.579782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.579782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.579782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] PATH_INFO: `/v3/users/67674cb7b079435791d6908ce4929900` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.579782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67674cb7b079435791d6908ce4929900)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.579782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.824201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67674cb7b079435791d6908ce4929900'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.910095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67674cb7b079435791d6908ce4929900'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.910659 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67674cb7b079435791d6908ce4929900'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.923564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67674cb7b079435791d6908ce4929900'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.924258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67674cb7b079435791d6908ce4929900'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.936968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1160/2338] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:49 2022] DELETE /identity/v3/users/67674cb7b079435791d6908ce4929900 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:49.941554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.942067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.942160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.959861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:49.961126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.020826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1179/2339] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:50.029523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.031899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.046116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.101387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4802-638b-45f6-914e-966696923743 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.105638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.106298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.106578 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.106857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.119268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.119268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.129816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1161/2340] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:50.514781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.544111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.741465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.742929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.751547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.757888 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6fa63-d936-41ed-bfed-3ee8b04e0ef7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.762919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.763804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.764087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.764600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] PATH_INFO: `/v3/projects/f873be694ac942fdbbf608f4ca6e2217` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.765841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f873be694ac942fdbbf608f4ca6e2217)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.767753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.885402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.886825 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f873be694ac942fdbbf608f4ca6e2217', 'request_id': 'req-5a43fd00-19f7-41a5-bede-7123e6577a28'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:50.967675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.993796 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f873be694ac942fdbbf608f4ca6e2217', 'request_id': 'req-5a43fd00-19f7-41a5-bede-7123e6577a28'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:50.997021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f873be694ac942fdbbf608f4ca6e2217', 'request_id': 'req-5a43fd00-19f7-41a5-bede-7123e6577a28'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.007800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] The token cache is being invalidate because project f873be694ac942fdbbf608f4ca6e2217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:51.008095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.008868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.010988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1180/2341] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:50 2022] DELETE /identity/v3/projects/f873be694ac942fdbbf608f4ca6e2217 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:51.014944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:51.024695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70bff1-2214-4cc6-809d-f497a1504488 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:51.093284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:51.097186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:51.097186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:51.097186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] PATH_INFO: `/v3/users/51854fcc2cb048cf92ea095fe6604852` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:51.097186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51854fcc2cb048cf92ea095fe6604852)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:51.098704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:51.367460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51854fcc2cb048cf92ea095fe6604852'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.479281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51854fcc2cb048cf92ea095fe6604852'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.480498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51854fcc2cb048cf92ea095fe6604852'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.505605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51854fcc2cb048cf92ea095fe6604852'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.506299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-1077948d-a2a8-4f73-aa2d-90dc9cc2a946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51854fcc2cb048cf92ea095fe6604852'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.525649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1162/2342] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:39:51 2022] DELETE /identity/v3/users/51854fcc2cb048cf92ea095fe6604852 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:51.673295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:51.768981 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:52.120625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.122826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.137894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43fd00-19f7-41a5-bede-7123e6577a28 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.201243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.202112 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.202395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.202669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] PATH_INFO: `/v3/projects/0cf2b11f6e244508bd4f4f697d2ec3a1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.203859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf2b11f6e244508bd4f4f697d2ec3a1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.205909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.341684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.343740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.344380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.363258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf2b11f6e244508bd4f4f697d2ec3a1', 'request_id': 'req-c7ae5fbc-a477-4cfc-b616-195db9035303'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.374662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:52.385145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.441814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1163/2343] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:52.460889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.461882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf2b11f6e244508bd4f4f697d2ec3a1', 'request_id': 'req-c7ae5fbc-a477-4cfc-b616-195db9035303'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.462864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.470621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf2b11f6e244508bd4f4f697d2ec3a1', 'request_id': 'req-c7ae5fbc-a477-4cfc-b616-195db9035303'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.482517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] The token cache is being invalidate because project 0cf2b11f6e244508bd4f4f697d2ec3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:52.482921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.483662 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c7ae5fbc-a477-4cfc-b616-195db9035303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.485434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1181/2344] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:39:52 2022] DELETE /identity/v3/projects/0cf2b11f6e244508bd4f4f697d2ec3a1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:52.491058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94fdb1-a178-43bd-947f-79de4c8ef4a9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.491484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94fdb1-a178-43bd-947f-79de4c8ef4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.491909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94fdb1-a178-43bd-947f-79de4c8ef4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.513374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ef94fdb1-a178-43bd-947f-79de4c8ef4a9 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:52.514975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef94fdb1-a178-43bd-947f-79de4c8ef4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.523416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1182/2345] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:52.532598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.532884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.533162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.549233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f21f6-d8a5-461c-a33f-c1f6dce89d07 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.552674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:52.553884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.554097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.555028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.555415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.555798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.558407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.562493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1183/2346] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:52.567318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.570414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.572276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.582977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451799d3-a567-4c45-a13d-c60eb387e21c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.585986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1164/2347] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:52.595568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.595568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.595568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.595568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.596848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:52.596848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.596848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.627483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.635369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1184/2348] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:39:52.639877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c4db-4747-4e3d-aba4-df29e5c9b1cb service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.645817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.647038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.647038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.647038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.648042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.650607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.829863 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:52.847277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1165/2349] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:52.848739 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.860742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039e42-9917-4fda-88c3-5ab251cb058a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.946433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.947153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.947441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.947725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.948444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.950431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.999616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:53.080604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1185/2350] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:53.085674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.098396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbc18-dcc1-425c-937a-5868d1c99521 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.106513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.107300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.107596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.108127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.109127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.110767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.132367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1166/2351] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:53.135491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.146199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6af7-19ef-49b2-a604-c51f964b8c36 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.152027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad122c98-4549-4c24-b371-4ff49a1da2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.152702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad122c98-4549-4c24-b371-4ff49a1da2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.152986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad122c98-4549-4c24-b371-4ff49a1da2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.158042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad122c98-4549-4c24-b371-4ff49a1da2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.158042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad122c98-4549-4c24-b371-4ff49a1da2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.158042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad122c98-4549-4c24-b371-4ff49a1da2c1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.178909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1186/2352] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:53.186032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.214302 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512211b2-70ca-41b0-bc65-80f5a19f0673 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.223057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.224395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.224864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.230337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] PATH_INFO: `/v3/projects/2a1cce79e5fb4545b3856328d2cdb218/users/28b898bdccd24cffaf1861a85d63bcbe/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.244537 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1cce79e5fb4545b3856328d2cdb218, user_id=28b898bdccd24cffaf1861a85d63bcbe, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.247328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.359120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1167/2353] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:39:53 2022] PUT /identity/v3/projects/2a1cce79e5fb4545b3856328d2cdb218/users/28b898bdccd24cffaf1861a85d63bcbe/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:53.370473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c340-2fce-490c-9fb1-1083fe504ba7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.371007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c340-2fce-490c-9fb1-1083fe504ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.371474 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c340-2fce-490c-9fb1-1083fe504ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.410871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ca01c340-2fce-490c-9fb1-1083fe504ba7 None None] MFA Rules not processed for user `28b898bdccd24cffaf1861a85d63bcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:53.412137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ca01c340-2fce-490c-9fb1-1083fe504ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.478900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1187/2354] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:53.499300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.501394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.563555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb8784-c7ac-4983-a5c4-f51e161d7dbb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.567589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f33d07-c7bd-41b5-af1a-c3811245d240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.568247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f33d07-c7bd-41b5-af1a-c3811245d240 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.568575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f33d07-c7bd-41b5-af1a-c3811245d240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.568846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f33d07-c7bd-41b5-af1a-c3811245d240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.578565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f33d07-c7bd-41b5-af1a-c3811245d240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.580023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f33d07-c7bd-41b5-af1a-c3811245d240 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.590089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1168/2355] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:54.014068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:54.151133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:54.905202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa6ed7-e051-481d-9238-c066048d3828 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.906006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa6ed7-e051-481d-9238-c066048d3828 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.906006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa6ed7-e051-481d-9238-c066048d3828 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.907250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1188/2356] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:54.920506 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f2af-39e9-4db3-af54-91c48cca14d5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.921318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f2af-39e9-4db3-af54-91c48cca14d5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.921318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f2af-39e9-4db3-af54-91c48cca14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.975222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a03f2af-39e9-4db3-af54-91c48cca14d5 None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:54.976833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a03f2af-39e9-4db3-af54-91c48cca14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.066916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1169/2357] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:55.083078 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa6ed7-e051-481d-9238-c066048d3828 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:55.084913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7afa6ed7-e051-481d-9238-c066048d3828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.152673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa6ed7-e051-481d-9238-c066048d3828 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:55.156829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41b0e4-74ba-4a83-ab8a-82b503ce2353 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:55.157498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41b0e4-74ba-4a83-ab8a-82b503ce2353 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.157928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41b0e4-74ba-4a83-ab8a-82b503ce2353 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.158212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41b0e4-74ba-4a83-ab8a-82b503ce2353 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.170003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41b0e4-74ba-4a83-ab8a-82b503ce2353 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:55.171501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41b0e4-74ba-4a83-ab8a-82b503ce2353 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:55.187975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1189/2358] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:55.235808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:55.502056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8e92-8b1e-460b-8bd4-35ee80a7c9eb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.506438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8e92-8b1e-460b-8bd4-35ee80a7c9eb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.506438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8e92-8b1e-460b-8bd4-35ee80a7c9eb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.506438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1170/2359] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:55.509651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd15f-bbe2-42a3-b4ca-a50e2205167a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.509945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd15f-bbe2-42a3-b4ca-a50e2205167a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.510229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd15f-bbe2-42a3-b4ca-a50e2205167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.530604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4bbcd15f-bbe2-42a3-b4ca-a50e2205167a None None] MFA Rules not processed for user `76f6fdb7d7074ddba6170f110c750489`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:55.531849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4bbcd15f-bbe2-42a3-b4ca-a50e2205167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.614990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1190/2360] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:39:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:55.632053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8e92-8b1e-460b-8bd4-35ee80a7c9eb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:55.634173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-762b8e92-8b1e-460b-8bd4-35ee80a7c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.652724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8e92-8b1e-460b-8bd4-35ee80a7c9eb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:55.656713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec4217-6d74-48a0-8257-5fd848ab49b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:55.658195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4217-6d74-48a0-8257-5fd848ab49b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.658486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4217-6d74-48a0-8257-5fd848ab49b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.658762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4217-6d74-48a0-8257-5fd848ab49b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.668316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec4217-6d74-48a0-8257-5fd848ab49b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:55.669707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec4217-6d74-48a0-8257-5fd848ab49b0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:55.679306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1171/2361] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:55.770215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e6ad-3494-4784-bb90-f0269ff18578 None None] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.781404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e6ad-3494-4784-bb90-f0269ff18578 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.781404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e6ad-3494-4784-bb90-f0269ff18578 None None] PATH_INFO: `/` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.781404 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1191/2362] 10.222.0.67 () {54 vars in 921 bytes} [Fri May 27 09:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:55.781684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1bce-cf72-4c1d-a82d-76839ac43dbc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.781684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1bce-cf72-4c1d-a82d-76839ac43dbc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.781684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1bce-cf72-4c1d-a82d-76839ac43dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.799350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb1e1bce-cf72-4c1d-a82d-76839ac43dbc None None] MFA Rules not processed for user `cd4d716fddeb41d1a697a0f23db35a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:55.800716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb1e1bce-cf72-4c1d-a82d-76839ac43dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.810076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1172/2363] 10.222.0.67 () {58 vars in 1018 bytes} [Fri May 27 09:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:55.823515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e6ad-3494-4784-bb90-f0269ff18578 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:55.835959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e6ad-3494-4784-bb90-f0269ff18578 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:55.840217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:55.841116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.841521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.841903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.857548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:55.859347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:55.870947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1192/2364] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:39:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:55.963270 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:56.221565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03f21e-776c-47f9-a366-7841d7ef06c0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:56.223158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03f21e-776c-47f9-a366-7841d7ef06c0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:56.223430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03f21e-776c-47f9-a366-7841d7ef06c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:56.250235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0d03f21e-776c-47f9-a366-7841d7ef06c0 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:56.251498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0d03f21e-776c-47f9-a366-7841d7ef06c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:56.346637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1173/2365] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:39:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:56.363480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:56.365089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:56.449209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b29f8-ecd5-4ed8-920b-6f69a48f0510 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:56.457498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:56.458412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:56.458792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:56.459243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:56.469335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:56.470992 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:56.482235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1193/2366] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:39:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:39:57.092621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:57.671582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.898709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:59.751399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.282170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.366585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.986431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.110897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.603771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.635547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.636504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.636504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.655088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:01.656374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:01.657933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.668641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1174/2367] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:40:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:01.685165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:01.696679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8fe4-2aa5-4a12-abec-12e88989b504 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.703266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf4eec-5ecd-4025-a989-2b2c052509d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.703985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4eec-5ecd-4025-a989-2b2c052509d0 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.704280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4eec-5ecd-4025-a989-2b2c052509d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.704783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4eec-5ecd-4025-a989-2b2c052509d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.715433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf4eec-5ecd-4025-a989-2b2c052509d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.717509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf4eec-5ecd-4025-a989-2b2c052509d0 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.727089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1194/2368] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:40:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:40:02.314752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:02.349143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:03.103692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:12.543988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=24 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:13.641441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=57 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:14.890514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.105020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077924-fe66-4631-b3bb-463e02e62165 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.129654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.132076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.134861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.134861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] PATH_INFO: `/v3/users/28b898bdccd24cffaf1861a85d63bcbe` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.137790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b898bdccd24cffaf1861a85d63bcbe)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.144565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.720112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b898bdccd24cffaf1861a85d63bcbe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.834655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b898bdccd24cffaf1861a85d63bcbe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.836074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b898bdccd24cffaf1861a85d63bcbe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.908757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b898bdccd24cffaf1861a85d63bcbe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.909971 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b898bdccd24cffaf1861a85d63bcbe'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.960068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1175/2369] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:40:14 2022] DELETE /identity/v3/users/28b898bdccd24cffaf1861a85d63bcbe => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:15.964623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.965812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.965812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.990985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:15.995459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.078123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1195/2370] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:16.094118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.102903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.287844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f43879-8093-44d4-bb6f-43d29bbb3477 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:16.302303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:16.302303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:16.302303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:16.308739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:16.342074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:16.348356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:16.364210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1176/2371] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:16.413544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.415852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.475163 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc03979-9b91-4246-bb3c-70d0192f8943 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:16.492007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:16.492808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:16.493582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:16.493948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:16.503434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.694621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:16.696730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134185-6df2-4d27-ac93-fd15f329f0f6 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:16.710263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1196/2372] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:40:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:17.169075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:17.172102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.233947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c977808-7dc7-4bfe-ba5b-dda09ca9ad14 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.250699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.253979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.254665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.255252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] PATH_INFO: `/v3/projects/2a1cce79e5fb4545b3856328d2cdb218` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.258881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1cce79e5fb4545b3856328d2cdb218)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.263683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:17.326951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:17.563606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1cce79e5fb4545b3856328d2cdb218', 'request_id': 'req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.587737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1cce79e5fb4545b3856328d2cdb218', 'request_id': 'req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.603243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1cce79e5fb4545b3856328d2cdb218', 'request_id': 'req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.779445 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] The token cache is being invalidate because project 2a1cce79e5fb4545b3856328d2cdb218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:17.780066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.782035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6c826b30-c9f1-4599-b6b7-98e4f99e5b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.786255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1177/2373] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:40:17 2022] DELETE /identity/v3/projects/2a1cce79e5fb4545b3856328d2cdb218 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:17.796517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b74-9177-43e4-ac20-c9dc59cc07af None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.797070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b74-9177-43e4-ac20-c9dc59cc07af None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.797451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b74-9177-43e4-ac20-c9dc59cc07af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.870383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.870893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.871170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.907663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-47655b74-9177-43e4-ac20-c9dc59cc07af None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:17.909783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-47655b74-9177-43e4-ac20-c9dc59cc07af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.923680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:17.927688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.068484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1178/2374] 10.222.0.67 () {58 vars in 967 bytes} [Fri May 27 09:40:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:18.091905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1197/2375] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:18.100548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.103281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.107639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.107974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.108200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.132010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:18.135236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.152368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1198/2376] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:18.159391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.172990 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434750d1-c676-4cc5-9e10-bcd51db169de None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.180189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.181342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.181709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.182628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.183339 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:18.183968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.186779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.216843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1199/2377] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:18.218556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.247456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7952-8456-4733-9a69-7e4ed3c67abe admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.273205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.273932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.274222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.274508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.275236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.277383 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.321858 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.330518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f63d9-272f-45d7-aa3b-ee91287d8245 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.344789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.347186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.348556 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.358110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.385915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.392740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.412608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1179/2378] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:40:18.422741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1200/2379] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:18.430051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.482446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291915f0-137e-47a4-aca9-6bcb170b483e service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.589228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.632590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.633820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.634310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.635082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.636880 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.642131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.843984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1180/2380] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/users => generated 292 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:18.847169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.888779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfbdf1-db0f-4826-bc90-fd349a120e3d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.901777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.902470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.903352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.903691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.904517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.906350 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.924016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1201/2381] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:18.928221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.946219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b7d4-ff47-45f4-8249-45ef1e4878a6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.952719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10935c-307e-441b-9230-7cbab73e67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.954343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10935c-307e-441b-9230-7cbab73e67ca admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.954343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10935c-307e-441b-9230-7cbab73e67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.954343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10935c-307e-441b-9230-7cbab73e67ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.954834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10935c-307e-441b-9230-7cbab73e67ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.956779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10935c-307e-441b-9230-7cbab73e67ca admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.975062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1181/2382] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:18.975874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.986312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d7700-c079-468c-8867-16d76cd2ed29 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.991476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.992733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.993117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.993645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] PATH_INFO: `/v3/projects/fa8bff9b426840d0810e105707dc4b55/users/0bc9b409530045aebdb3a6891da9e3a0/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.010506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8bff9b426840d0810e105707dc4b55, user_id=0bc9b409530045aebdb3a6891da9e3a0, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.014875 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.186516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1202/2383] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:40:18 2022] PUT /identity/v3/projects/fa8bff9b426840d0810e105707dc4b55/users/0bc9b409530045aebdb3a6891da9e3a0/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:19.199452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2385ab-1bee-4834-a5cb-ac93da89bdc7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.200392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2385ab-1bee-4834-a5cb-ac93da89bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.200722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2385ab-1bee-4834-a5cb-ac93da89bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.231573 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-eb2385ab-1bee-4834-a5cb-ac93da89bdc7 None None] MFA Rules not processed for user `0bc9b409530045aebdb3a6891da9e3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:19.232827 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-eb2385ab-1bee-4834-a5cb-ac93da89bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.309813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1182/2384] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:19.322216 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.324124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.446184 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797fe75-9e5b-4bcc-9582-1bb56bade89e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.454151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.457652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.457652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.457652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.470729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.473245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.493253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1203/2385] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:23.116733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:23.117835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:23.118369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:23.141072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] MFA Rules not processed for user `4b92eed1018941d0b9fd6a08f276bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:23.142313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:23.258187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1183/2386] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:23.380522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:23.493827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18f293-79f3-4b4c-8965-c1dda74a079f service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:23.504279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:23.505924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:23.506726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:23.507204 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] PATH_INFO: `/v3/users/0bc9b409530045aebdb3a6891da9e3a0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:23.511158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc9b409530045aebdb3a6891da9e3a0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:23.515248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:23.898285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:23.901676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:23.930654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcac338-654f-4deb-9640-aa320f56e141 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:23.941733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:23.943824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:23.944568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:23.945178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] PATH_INFO: `/v3/users/905f2cad8ff5493388c6a334fb42372f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:23.948089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905f2cad8ff5493388c6a334fb42372f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:23.953264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:23.971844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc9b409530045aebdb3a6891da9e3a0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.094294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc9b409530045aebdb3a6891da9e3a0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.095699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc9b409530045aebdb3a6891da9e3a0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.096750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc9b409530045aebdb3a6891da9e3a0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.108293 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.114854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4471f902-b33e-4dcf-a6fe-58fe3ac3bcbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc9b409530045aebdb3a6891da9e3a0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.129102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1204/2387] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:40:23 2022] DELETE /identity/v3/users/0bc9b409530045aebdb3a6891da9e3a0 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:24.134185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:24.138144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:24.138144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:24.154690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:24.156256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:24.283292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1205/2388] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:24.294930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:24.296955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:24.477529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519252c-55f8-47ce-8baa-466931d4e8d7 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:24.496290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:24.498620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:24.499608 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:24.500898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:24.506848 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905f2cad8ff5493388c6a334fb42372f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.512558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.553701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:24.560073 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:24.585681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1206/2389] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:24.596368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905f2cad8ff5493388c6a334fb42372f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.597378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905f2cad8ff5493388c6a334fb42372f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.634611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905f2cad8ff5493388c6a334fb42372f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.636938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905f2cad8ff5493388c6a334fb42372f'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.665744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1184/2390] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:40:23 2022] DELETE /identity/v3/users/905f2cad8ff5493388c6a334fb42372f => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:25.035018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.035018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:25.089274 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898973-2bbe-4ff4-8ba6-1b43299b60ba service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.243110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.244249 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.244632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.245074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] PATH_INFO: `/v3/projects/3b37a8d8f28a4f87a0571decf4816afc` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.246631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b37a8d8f28a4f87a0571decf4816afc)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.250316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.394476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b37a8d8f28a4f87a0571decf4816afc', 'request_id': 'req-35efd1cc-a88c-4178-8944-92cf1fda2b8d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.517113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.520015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:25.555746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dff58-cc35-448e-8569-f1b4f066d6d1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.560493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b37a8d8f28a4f87a0571decf4816afc', 'request_id': 'req-35efd1cc-a88c-4178-8944-92cf1fda2b8d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.572948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b37a8d8f28a4f87a0571decf4816afc', 'request_id': 'req-35efd1cc-a88c-4178-8944-92cf1fda2b8d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.610814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] The token cache is being invalidate because project 3b37a8d8f28a4f87a0571decf4816afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:25.611911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.612922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-35efd1cc-a88c-4178-8944-92cf1fda2b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.615561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1207/2391] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:40:25 2022] DELETE /identity/v3/projects/3b37a8d8f28a4f87a0571decf4816afc => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:25.717352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.718687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.719039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.719467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] PATH_INFO: `/v3/projects/fa8bff9b426840d0810e105707dc4b55` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.721374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8bff9b426840d0810e105707dc4b55)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.723954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.933539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8bff9b426840d0810e105707dc4b55', 'request_id': 'req-0c836ed4-57c8-45ee-bb3a-90d792693e87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.949292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8bff9b426840d0810e105707dc4b55', 'request_id': 'req-0c836ed4-57c8-45ee-bb3a-90d792693e87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.963068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8bff9b426840d0810e105707dc4b55', 'request_id': 'req-0c836ed4-57c8-45ee-bb3a-90d792693e87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.992397 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:26.076609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] The token cache is being invalidate because project fa8bff9b426840d0810e105707dc4b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:26.076938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:26.079000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:26.081320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1185/2392] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:40:25 2022] DELETE /identity/v3/projects/fa8bff9b426840d0810e105707dc4b55 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:32.016175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05aae6-4008-42a1-82a7-fa053a57e4fe None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:32.019512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05aae6-4008-42a1-82a7-fa053a57e4fe None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:32.021008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05aae6-4008-42a1-82a7-fa053a57e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:32.053385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-3d05aae6-4008-42a1-82a7-fa053a57e4fe None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:32.054738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3d05aae6-4008-42a1-82a7-fa053a57e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:32.141850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1208/2393] 10.222.0.67 () {58 vars in 967 bytes} [Fri May 27 09:40:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:32.159977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:32.161313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:32.240937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:32.265092 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c836ed4-57c8-45ee-bb3a-90d792693e87 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:32.272191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:32.273134 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:32.273568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:32.274045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:32.286407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:32.288179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:32.304895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1186/2394] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:40:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:40:42.131177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=6,keystone:SELECT=39,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:42.978256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:48.511536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d764f-e3cb-4c19-9d7f-7e9b3bc6ed6e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:48.512092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d764f-e3cb-4c19-9d7f-7e9b3bc6ed6e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:48.512208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d764f-e3cb-4c19-9d7f-7e9b3bc6ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:48.532502 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0e9d764f-e3cb-4c19-9d7f-7e9b3bc6ed6e None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:48.533735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0e9d764f-e3cb-4c19-9d7f-7e9b3bc6ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:48.602218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1209/2395] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:48.617418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:48.619655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:48.704976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c407e4-68c3-4e58-af72-84e6ef85d3b0 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:48.710732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1764ff-5c3f-4619-9c1a-a71fd3177f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:48.711397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1764ff-5c3f-4619-9c1a-a71fd3177f00 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:48.711684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1764ff-5c3f-4619-9c1a-a71fd3177f00 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:48.711965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1764ff-5c3f-4619-9c1a-a71fd3177f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:48.721536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1764ff-5c3f-4619-9c1a-a71fd3177f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:48.723160 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1764ff-5c3f-4619-9c1a-a71fd3177f00 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:48.733388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1187/2396] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:51.872821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656efad-2935-4ab1-8028-d8645543828e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:51.873368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656efad-2935-4ab1-8028-d8645543828e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:51.873368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656efad-2935-4ab1-8028-d8645543828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:51.892103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1656efad-2935-4ab1-8028-d8645543828e None None] MFA Rules not processed for user `82bf01c0cdbc48fa9b78933314039ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:51.893396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1656efad-2935-4ab1-8028-d8645543828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:51.950897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1210/2397] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:40:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:54.254533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8c4bc-ab29-4a2f-b12f-c97ff2dbd9ea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:54.255075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8c4bc-ab29-4a2f-b12f-c97ff2dbd9ea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:54.255170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8c4bc-ab29-4a2f-b12f-c97ff2dbd9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:54.273275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-86b8c4bc-ab29-4a2f-b12f-c97ff2dbd9ea None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:54.274487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-86b8c4bc-ab29-4a2f-b12f-c97ff2dbd9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:54.282696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1188/2398] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:54.305750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656efad-2935-4ab1-8028-d8645543828e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:54.307297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1656efad-2935-4ab1-8028-d8645543828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:54.324129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656efad-2935-4ab1-8028-d8645543828e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:54.330289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:54.330954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:54.331240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:54.331523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:54.340717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:54.342398 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:54.352959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1211/2399] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:01.086062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbb117-07f9-497c-a7eb-377962b57146 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:01.086679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbb117-07f9-497c-a7eb-377962b57146 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:01.086679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbb117-07f9-497c-a7eb-377962b57146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:01.108792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7acbb117-07f9-497c-a7eb-377962b57146 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:01.110749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7acbb117-07f9-497c-a7eb-377962b57146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:01.120010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1189/2400] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:41:01.149649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:01.165993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6c17e-dd87-4e62-8dad-0165c6580abb service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:01.172629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:01.173352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:01.173635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:01.173912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:01.184857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:01.186360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:01.198866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1212/2401] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:05.346484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f409b-032e-495b-aac8-158e99679a5f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:05.347017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f409b-032e-495b-aac8-158e99679a5f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:05.347174 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f409b-032e-495b-aac8-158e99679a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:05.367994 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b3f409b-032e-495b-aac8-158e99679a5f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:05.369372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b3f409b-032e-495b-aac8-158e99679a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:05.384670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1190/2402] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:41:05.417764 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:05.432079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4668a4-27a6-4d5a-9b1f-f5c1be6d03e9 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:05.438040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:05.438697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:05.438978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:05.439256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:05.449218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:05.452731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:05.464271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1213/2403] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:09.686782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8751ce-cdea-4c68-b701-c932262ffa92 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:09.687469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8751ce-cdea-4c68-b701-c932262ffa92 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:09.687469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8751ce-cdea-4c68-b701-c932262ffa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:09.706521 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf8751ce-cdea-4c68-b701-c932262ffa92 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:09.707653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf8751ce-cdea-4c68-b701-c932262ffa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:09.715930 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1191/2404] 10.222.0.40 () {58 vars in 1016 bytes} [Fri May 27 09:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:09.736599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:09.748307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914320-d4e5-45ed-9283-9ba7566e0e12 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:09.754628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1930e4-1c23-4a27-a530-8114f02884ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:09.755299 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1930e4-1c23-4a27-a530-8114f02884ff service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:09.755577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1930e4-1c23-4a27-a530-8114f02884ff service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:09.755852 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1930e4-1c23-4a27-a530-8114f02884ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:09.764685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1930e4-1c23-4a27-a530-8114f02884ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:09.766261 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1930e4-1c23-4a27-a530-8114f02884ff service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:09.775911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1214/2405] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:19.701227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=46 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:19.771954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=76 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:36.236709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:36.236709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:36.236709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:36.252490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] MFA Rules not processed for user `415775dc8e6a484d8894bdeaab4da631`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:36.253703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:36.315825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1192/2406] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:36.966263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:36.966846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:36.966979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:36.985886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] MFA Rules not processed for user `9e8aada8bb9642319ea99af1f98b9f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:36.987161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:37.047716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1215/2407] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:46.308777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=25 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:47.040560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=25 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:50.525929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:50.528182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:50.591816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911c21-0534-4030-b582-16aa4b062193 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:50.595440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:50.596093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:50.596406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:50.596695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:50.598554 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:50.615158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:50.617874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:50.628043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1193/2408] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:41:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:53.679326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:53.680892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:53.694105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a449b-1a43-4c11-9c60-8fed363b94c4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:53.698709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:53.699487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:53.699848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:53.700196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:53.702142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:53.720121 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:53.725507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:53.735453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1216/2409] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:41:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:56.531511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:56.533096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:56.558487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fd138-4d72-447d-a01d-76a6ab6aee48 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:56.563008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:56.564414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:56.565285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:56.565580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] PATH_INFO: `/v3/users/4b92eed1018941d0b9fd6a08f276bd87` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:56.566884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b92eed1018941d0b9fd6a08f276bd87)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:56.568933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:56.849609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b92eed1018941d0b9fd6a08f276bd87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:57.023925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b92eed1018941d0b9fd6a08f276bd87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:57.024692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b92eed1018941d0b9fd6a08f276bd87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:57.038257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b92eed1018941d0b9fd6a08f276bd87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:57.039069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f5a7fa89-be94-49b1-bf0b-465036a1d701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b92eed1018941d0b9fd6a08f276bd87'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:57.053296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1194/2410] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:41:56 2022] DELETE /identity/v3/users/4b92eed1018941d0b9fd6a08f276bd87 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:41:57.585518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:57.591392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984e88-7d9a-4949-826f-312751fc15f8 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:57.673556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:57.675194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:57.675547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:57.676021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] PATH_INFO: `/v3/projects/a7aec0311e784f57af1de74543007184` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:57.677629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7aec0311e784f57af1de74543007184)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:57.679610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:57.894551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7aec0311e784f57af1de74543007184', 'request_id': 'req-4a1f39f8-5654-4cf5-840e-ada87c43632e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:58.135040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7aec0311e784f57af1de74543007184', 'request_id': 'req-4a1f39f8-5654-4cf5-840e-ada87c43632e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:58.144993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7aec0311e784f57af1de74543007184', 'request_id': 'req-4a1f39f8-5654-4cf5-840e-ada87c43632e'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:58.161054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] The token cache is being invalidate because project a7aec0311e784f57af1de74543007184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:41:58.161694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:58.162536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4a1f39f8-5654-4cf5-840e-ada87c43632e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:58.164877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1217/2411] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:41:57 2022] DELETE /identity/v3/projects/a7aec0311e784f57af1de74543007184 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:41:58.169838 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.170402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.170402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.188397 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:58.189528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:58.282963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1195/2412] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:58.285707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.286434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.286959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.318565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:58.319803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:58.329920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1218/2413] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:58.333658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:58.344419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f16f4-b383-4433-88e4-84c0d41ccc1d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:58.351802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:58.376984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.376984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.376984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.376984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:41:58.376984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:58.376984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:58.377650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1196/2414] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:41:58.378278 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:58.389215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb9bd2-27eb-48ad-b919-75fb7b69f013 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:58.394547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:58.395226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.395511 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.395821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.396526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:58.398492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:58.620238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1219/2415] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:41:58 2022] POST /identity/v3/projects => generated 391 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:41:58.622093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:58.627596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:58.633490 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c0906-bb82-4184-939d-dc9e900f3227 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:58.733000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:58.733769 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.734059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.734331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.735035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:58.737030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:58.905545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1197/2416] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:41:58 2022] POST /identity/v3/users => generated 296 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:41:58.918185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:58.921385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb462da-8321-4bfd-b17c-18e3d8048a77 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:58.926755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:58.927672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.928119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.928433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.929228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:58.931100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:58.942267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1220/2417] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:41:58.946371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:58.957481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9e93-9dbb-4549-addb-496bc64f0dd7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:58.966817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e9ee4-59df-4474-af8e-9c22b7ef8171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:58.967704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e9ee4-59df-4474-af8e-9c22b7ef8171 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:58.968214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e9ee4-59df-4474-af8e-9c22b7ef8171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:58.968679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e9ee4-59df-4474-af8e-9c22b7ef8171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:58.969553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e9ee4-59df-4474-af8e-9c22b7ef8171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:58.971946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e9ee4-59df-4474-af8e-9c22b7ef8171 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:58.989062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1198/2418] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:41:58.989975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:59.007716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3f00-fb07-40e2-8b4a-99db67294938 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:59.014836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:59.015382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:59.015672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:59.015952 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] PATH_INFO: `/v3/projects/c1feb6531c124c01899d6e125a7b6dd9/users/ff4902785ef54edfa9023e1828687a76/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:59.034985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1feb6531c124c01899d6e125a7b6dd9, user_id=ff4902785ef54edfa9023e1828687a76, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:59.037763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:59.249612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1221/2419] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:41:58 2022] PUT /identity/v3/projects/c1feb6531c124c01899d6e125a7b6dd9/users/ff4902785ef54edfa9023e1828687a76/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:41:59.260368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:59.260906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:59.260906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:59.293318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] MFA Rules not processed for user `ff4902785ef54edfa9023e1828687a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:59.294674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:59.393034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1199/2420] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:41:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:59.404767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:59.408646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:59.422879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:59.477381 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59367-17ad-4fc9-80de-5088f1756f66 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:59.485716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:59.486560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:59.486941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:59.487290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:59.502798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:59.504657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:59.517245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1222/2421] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:41:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:02.975592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:02.977098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:03.057516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7d7f-b50b-4434-9603-42bc2c4c2b37 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:03.064024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:03.064772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:03.067504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:03.067504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:03.067504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:03.073801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:03.128555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:03.130182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:03.141561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1200/2422] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:07.824714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:07.825881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:07.882732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b11a84-4308-4d24-a82d-45fbaae5747e service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:07.886355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:07.887489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:07.887775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:07.888054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:07.890136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:07.953749 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:07.955384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:07.966667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1223/2423] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:11.911446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:11.913565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:11.997482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdff4a0-3c61-45ef-bd96-dd5fc99d2fee service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:12.002816 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:12.003561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:12.003875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:12.004122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:12.006043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:12.014405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:12.016304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:12.023558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:12.025274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:12.036487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae115-f94c-4df0-8fa2-7eb2b658945e service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:12.038354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1201/2424] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:12.038938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:12.039995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:12.040379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:12.040706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] PATH_INFO: `/v3/users/82bf01c0cdbc48fa9b78933314039ee1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:12.041972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bf01c0cdbc48fa9b78933314039ee1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:12.044692 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:12.284745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bf01c0cdbc48fa9b78933314039ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.384719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bf01c0cdbc48fa9b78933314039ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.385347 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bf01c0cdbc48fa9b78933314039ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.385968 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bf01c0cdbc48fa9b78933314039ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.392902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:12.399801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bf01c0cdbc48fa9b78933314039ee1'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.412908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1224/2425] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:12 2022] DELETE /identity/v3/users/82bf01c0cdbc48fa9b78933314039ee1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:12.437701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:12.448725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae60de-d322-42d2-9dd0-47ed2b7bf847 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:12.510032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:12.511247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:12.511502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:12.511619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] PATH_INFO: `/v3/users/ff4902785ef54edfa9023e1828687a76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:12.513330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4902785ef54edfa9023e1828687a76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:12.515569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:12.687319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:12.688892 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:12.704881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45364aa0-404a-4d0e-b354-567ca3f7e9fc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:12.709766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:12.710717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:12.711635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:12.711922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] PATH_INFO: `/v3/projects/6a4290d24d1243679ce74b9d94a6b2f0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:12.713363 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4290d24d1243679ce74b9d94a6b2f0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:12.715333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:12.773202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:12.778874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4902785ef54edfa9023e1828687a76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.879891 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4290d24d1243679ce74b9d94a6b2f0', 'request_id': 'req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.911005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4902785ef54edfa9023e1828687a76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.911748 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4902785ef54edfa9023e1828687a76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.932956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4902785ef54edfa9023e1828687a76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.932956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-662e5b97-1fc6-4770-a4a3-cc1c57c4ce83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4902785ef54edfa9023e1828687a76'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:12.948684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1202/2426] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:12 2022] DELETE /identity/v3/users/ff4902785ef54edfa9023e1828687a76 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:12.953230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249d34-5b61-4d6c-92d2-e4bfbe26fabe None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:12.953563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249d34-5b61-4d6c-92d2-e4bfbe26fabe None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:12.953944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249d34-5b61-4d6c-92d2-e4bfbe26fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:12.971331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a249d34-5b61-4d6c-92d2-e4bfbe26fabe None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:12.972584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a249d34-5b61-4d6c-92d2-e4bfbe26fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.030854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1203/2427] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:13.032166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb6472-ce06-4e86-b893-0123f67f2566 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.032501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb6472-ce06-4e86-b893-0123f67f2566 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.032790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb6472-ce06-4e86-b893-0123f67f2566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.044951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4290d24d1243679ce74b9d94a6b2f0', 'request_id': 'req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.060902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-48fb6472-ce06-4e86-b893-0123f67f2566 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:13.061082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4290d24d1243679ce74b9d94a6b2f0', 'request_id': 'req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.061187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-48fb6472-ce06-4e86-b893-0123f67f2566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.063418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] The token cache is being invalidate because project 6a4290d24d1243679ce74b9d94a6b2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:13.063798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.064545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.066126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1225/2428] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:12 2022] DELETE /identity/v3/projects/6a4290d24d1243679ce74b9d94a6b2f0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:13.067043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.068370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.112529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1204/2429] 10.222.0.67 () {58 vars in 967 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:13.141359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27719e8-ce81-4a58-90ff-9165495ab7e6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.141359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27719e8-ce81-4a58-90ff-9165495ab7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.141359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27719e8-ce81-4a58-90ff-9165495ab7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.144194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3322b3-5fd2-4d20-8c5b-fe6c1fcf7253 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.144800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a27719e8-ce81-4a58-90ff-9165495ab7e6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:13.144800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a27719e8-ce81-4a58-90ff-9165495ab7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.152262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1205/2430] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:13.159805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.160093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.160411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.180228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:13.182387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.190215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.190215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.190215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.190215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.190726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1206/2431] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:13.192036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.194600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.204100 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9d241-3466-4d21-bf6b-ac8886312210 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.206031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.207491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.209061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.209703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.210041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.210374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.211102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:13.211410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.213043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.218949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1226/2432] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:13.226041 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1207/2433] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:42:13.233456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.243639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b7b69-27a8-4803-94ba-f70b6675f8ba service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.249090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.249775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.250060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.250469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.251166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.253122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.310309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.310977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.350588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:13.375963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:13.379610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43356-3abc-4b17-a0f7-52b8669d0670 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.386675 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1227/2434] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:13.386840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.386840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.386840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.386840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.387773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.396364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.398060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.407015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1208/2435] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:42:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:42:13.455476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa9d1-95aa-4d9a-b991-f8fc7610be9d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.461668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.465787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.465787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.465787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.465787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.467218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.567628 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1228/2436] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:13.569326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.579881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece9a6c-3b48-43c3-b705-509eee3d73d3 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.584630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.585296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.585575 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.585855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.586584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.588215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.601881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1209/2437] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:13.603077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.614139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cd466-9280-4540-94ce-f32582570dee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.619498 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.620123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.620447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.620760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.621489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.623107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.633372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1229/2438] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:13.638143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.657991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18626-d9ab-4857-b423-f3b7a0eb5abb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.657991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf64498-a032-4fbf-a895-e7bc27a62b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.657991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf64498-a032-4fbf-a895-e7bc27a62b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.657991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf64498-a032-4fbf-a895-e7bc27a62b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.658404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf64498-a032-4fbf-a895-e7bc27a62b39 admin admin] PATH_INFO: `/v3/projects/cd0e458db8a54cd1af7f924eebce698b/users/5043cbaaba1d4d2a986eab4134d8c350/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.671047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf64498-a032-4fbf-a895-e7bc27a62b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0e458db8a54cd1af7f924eebce698b, user_id=5043cbaaba1d4d2a986eab4134d8c350, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.673826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf64498-a032-4fbf-a895-e7bc27a62b39 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.686148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.687889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.702800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc547b8d-5cf7-4824-9d2b-67410b04762a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.713166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.714210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.714495 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.714778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] PATH_INFO: `/v3/projects/c1feb6531c124c01899d6e125a7b6dd9` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.716010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1feb6531c124c01899d6e125a7b6dd9)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.718051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.802373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1210/2439] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:13 2022] PUT /identity/v3/projects/cd0e458db8a54cd1af7f924eebce698b/users/5043cbaaba1d4d2a986eab4134d8c350/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:13.813133 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.813418 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.813701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.839941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] MFA Rules not processed for user `5043cbaaba1d4d2a986eab4134d8c350`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:13.841225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.873661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1feb6531c124c01899d6e125a7b6dd9', 'request_id': 'req-68628bc9-942c-454d-aa95-8dd32739f79c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.910525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1211/2440] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:13.913013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.967549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1feb6531c124c01899d6e125a7b6dd9', 'request_id': 'req-68628bc9-942c-454d-aa95-8dd32739f79c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.971720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1feb6531c124c01899d6e125a7b6dd9', 'request_id': 'req-68628bc9-942c-454d-aa95-8dd32739f79c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.976977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839797ba-04ac-4efd-8142-8bebd4cda374 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.983046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] The token cache is being invalidate because project c1feb6531c124c01899d6e125a7b6dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:13.983411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.984136 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-68628bc9-942c-454d-aa95-8dd32739f79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:13.985780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1230/2441] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:13 2022] DELETE /identity/v3/projects/c1feb6531c124c01899d6e125a7b6dd9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:13.994312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27abb-c940-4ae3-a3d3-ce651cc485bd None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.994312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27abb-c940-4ae3-a3d3-ce651cc485bd None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.994312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27abb-c940-4ae3-a3d3-ce651cc485bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.003332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.010570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-07f27abb-c940-4ae3-a3d3-ce651cc485bd None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.011767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-07f27abb-c940-4ae3-a3d3-ce651cc485bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.035918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.036937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.036937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.037144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.037828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.039746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.068748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.077740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1231/2442] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:14.085100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221da758-a697-481e-a71f-a85526d794bb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.085351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221da758-a697-481e-a71f-a85526d794bb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.085633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221da758-a697-481e-a71f-a85526d794bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.104473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-221da758-a697-481e-a71f-a85526d794bb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.105730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-221da758-a697-481e-a71f-a85526d794bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.113627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1232/2443] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:14.117715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221da758-a697-481e-a71f-a85526d794bb None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.127036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221da758-a697-481e-a71f-a85526d794bb None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.132119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.132819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.133108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.133390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.134117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:14.134505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.136139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.137862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1212/2444] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:13 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:14.142987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.144762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.152535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1233/2445] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:42:14.153490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.163950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb9335-6551-4dc0-ada8-47ada070241a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.216410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401c52-3327-4f51-a69c-d12c9198c359 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.221380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.221902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.222188 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.222468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.222577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.223131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.223240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.223411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.223686 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.224396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.225112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.226396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.336147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1213/2446] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:14.340076 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.350623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5661-7324-4558-9f5a-79fe0d932a4e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.354835 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1234/2447] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/projects => generated 399 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:14.356368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.357105 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.357391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.357682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.358557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.359042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.360179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.371635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1214/2448] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:14.375529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.386187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadab49-c1bc-49ba-80f9-36c24669070a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.424639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d686-d7bf-4153-a8b2-5fdbc0ead720 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.429549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.430225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.430512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.430797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.431512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.433494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.447042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.447951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.448351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.448560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] PATH_INFO: `/v3/projects/cc0221128be440aba041e37843f3f16b/users/3c959e4c97b944769bf210fb8ab24172/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.464055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0221128be440aba041e37843f3f16b, user_id=3c959e4c97b944769bf210fb8ab24172, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.466819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.510925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1235/2449] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:14.515277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.525518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d04078-a529-497b-8c63-4006caf0aa41 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.530666 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.531586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.532569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.533963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.536868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.539614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.541256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1215/2450] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:14 2022] PUT /identity/v3/projects/cc0221128be440aba041e37843f3f16b/users/3c959e4c97b944769bf210fb8ab24172/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:14.545313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.554698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1236/2451] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:14.560030 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.562716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.572571 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b78bb-a352-4db2-90e0-84c873c5c39e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.608934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab7a9a-1414-489c-bc4d-481fb237996e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.614698 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.615102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.615392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.615673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.616153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.616641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.618466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.630866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1216/2452] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:14.635221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.642900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.643599 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.643884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.644160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.644939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.646121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dc4b7-4d1b-4847-b849-e4fbee71084c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.646767 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.652231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdc181-0b93-47ca-8003-dc0f8f340fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.653187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdc181-0b93-47ca-8003-dc0f8f340fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.653602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdc181-0b93-47ca-8003-dc0f8f340fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.653807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdc181-0b93-47ca-8003-dc0f8f340fbf admin admin] PATH_INFO: `/v3/projects/cc0221128be440aba041e37843f3f16b/users/3c959e4c97b944769bf210fb8ab24172/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.662079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdc181-0b93-47ca-8003-dc0f8f340fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0221128be440aba041e37843f3f16b, user_id=3c959e4c97b944769bf210fb8ab24172, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.662195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1237/2453] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:14.662284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdc181-0b93-47ca-8003-dc0f8f340fbf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.663704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.671914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1217/2454] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:14 2022] PUT /identity/v3/projects/cc0221128be440aba041e37843f3f16b/users/3c959e4c97b944769bf210fb8ab24172/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:14.674962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bf2ce-e1c0-4812-bc12-708da26e184f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.683966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.684818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.685102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.715452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] MFA Rules not processed for user `3c959e4c97b944769bf210fb8ab24172`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.716723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.754774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0b402-1b6e-4ad0-98f1-c480c90bfbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.756069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0b402-1b6e-4ad0-98f1-c480c90bfbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.756522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0b402-1b6e-4ad0-98f1-c480c90bfbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.756809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0b402-1b6e-4ad0-98f1-c480c90bfbd7 admin admin] PATH_INFO: `/v3/projects/acb7306affa94e259c0be2ed774d29a1/users/7661819f5bf2499faeeee8df3a49b5ce/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.773343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0b402-1b6e-4ad0-98f1-c480c90bfbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb7306affa94e259c0be2ed774d29a1, user_id=7661819f5bf2499faeeee8df3a49b5ce, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.775986 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0b402-1b6e-4ad0-98f1-c480c90bfbd7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.803334 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1218/2455] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:14.815158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.816729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.831349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1238/2456] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:14 2022] PUT /identity/v3/projects/acb7306affa94e259c0be2ed774d29a1/users/7661819f5bf2499faeeee8df3a49b5ce/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:14.842653 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.842978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.843222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.873681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] MFA Rules not processed for user `7661819f5bf2499faeeee8df3a49b5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.874910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.883762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d80d8-85c4-4dff-8a78-162bedad1ac3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.920516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.938110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.938771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.939052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.939324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.951729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1239/2457] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:14.962545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.963975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.977360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76856e-67b3-475e-bec7-cac29daabe46 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.981371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.982196 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.982668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.983102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.993072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.995004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.004915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.007494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.007826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1240/2458] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:42:15.019280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1219/2459] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:42:15.164437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.173682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a2bc-4666-4c3b-8b62-24e519715ceb service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.183452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.183452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.183452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.183452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.184100 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:15.245871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:15.276170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.277672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.292431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1241/2460] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:18.601217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:18.606812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:18.691797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb6a5-85ff-43ce-a0df-73ea0a5774b1 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:18.697605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:18.698262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:18.698547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:18.698823 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:18.701193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:18.712937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:18.714515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:18.725319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1220/2461] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:20.751002 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:20.856226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3ed2f-5a31-46ac-aecd-3496450e65c7 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:20.861556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:20.862480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:20.862757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:20.864094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] PATH_INFO: `/v3/users/5043cbaaba1d4d2a986eab4134d8c350` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:20.866152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5043cbaaba1d4d2a986eab4134d8c350)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:20.868414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:21.089180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5043cbaaba1d4d2a986eab4134d8c350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.172463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:21.182621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693c24c-9aeb-4dfd-8cd4-5e615cf82e2a service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:21.187441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:21.188366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:21.188653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:21.188936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] PATH_INFO: `/v3/users/7661819f5bf2499faeeee8df3a49b5ce` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:21.190245 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7661819f5bf2499faeeee8df3a49b5ce)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:21.192277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:21.238401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5043cbaaba1d4d2a986eab4134d8c350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.238673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5043cbaaba1d4d2a986eab4134d8c350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.239280 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5043cbaaba1d4d2a986eab4134d8c350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.253790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-0963e845-f056-4c6b-9312-ee93fa1652d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5043cbaaba1d4d2a986eab4134d8c350'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.276708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1242/2462] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:20 2022] DELETE /identity/v3/users/5043cbaaba1d4d2a986eab4134d8c350 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:21.276708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:21.276708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:21.276708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:21.293703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:21.294950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:21.351458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:21.360776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1243/2463] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:21.370369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:21.372309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:21.437274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7661819f5bf2499faeeee8df3a49b5ce'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.443727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226237-bb8f-4891-bf2e-a890d3eaff9c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:21.448168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957dc4-5a89-4ad3-b29b-d29c7a9b6adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:21.448677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957dc4-5a89-4ad3-b29b-d29c7a9b6adc service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:21.448959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957dc4-5a89-4ad3-b29b-d29c7a9b6adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:21.450795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957dc4-5a89-4ad3-b29b-d29c7a9b6adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:21.460624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37957dc4-5a89-4ad3-b29b-d29c7a9b6adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:21.462113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37957dc4-5a89-4ad3-b29b-d29c7a9b6adc service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:21.476352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1244/2464] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:42:21.516773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7661819f5bf2499faeeee8df3a49b5ce'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.517634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7661819f5bf2499faeeee8df3a49b5ce'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.540132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7661819f5bf2499faeeee8df3a49b5ce'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.541019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7661819f5bf2499faeeee8df3a49b5ce'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:21.542306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:21.554687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1221/2465] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:21 2022] DELETE /identity/v3/users/7661819f5bf2499faeeee8df3a49b5ce => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:21.559799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:21.560089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:21.560405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:21.579618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:21.581044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:21.644162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1245/2466] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:21.653995 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:21.655518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:21.720219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916485-ac95-481f-849c-ebf13b89b33c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:21.725366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:21.725989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:21.726367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:21.726606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:21.737217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:21.738663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:21.749277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1222/2467] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:21.987897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:21.987897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:22.004621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf41a9-09e8-43c5-b439-b0f6889090bc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:22.020793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:22.024787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:22.024787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:22.024787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] PATH_INFO: `/v3/projects/cd0e458db8a54cd1af7f924eebce698b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:22.024787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0e458db8a54cd1af7f924eebce698b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:22.026219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:22.186534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0e458db8a54cd1af7f924eebce698b', 'request_id': 'req-638338ac-c653-409e-8139-affa8e653db0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.255579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0e458db8a54cd1af7f924eebce698b', 'request_id': 'req-638338ac-c653-409e-8139-affa8e653db0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.263881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0e458db8a54cd1af7f924eebce698b', 'request_id': 'req-638338ac-c653-409e-8139-affa8e653db0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.279788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] The token cache is being invalidate because project cd0e458db8a54cd1af7f924eebce698b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:22.280076 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.282103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.283562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1246/2468] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:21 2022] DELETE /identity/v3/projects/cd0e458db8a54cd1af7f924eebce698b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:22.286896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:22.304552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb2ee-75a3-4eef-8106-b2ae84432126 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:22.376618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:22.377867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:22.378168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:22.378452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] PATH_INFO: `/v3/users/3c959e4c97b944769bf210fb8ab24172` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:22.380284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c959e4c97b944769bf210fb8ab24172)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:22.385072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:22.389486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:22.392431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:22.414273 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638338ac-c653-409e-8139-affa8e653db0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:22.424094 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:22.425072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:22.425360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:22.425637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] PATH_INFO: `/v3/projects/acb7306affa94e259c0be2ed774d29a1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:22.427111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb7306affa94e259c0be2ed774d29a1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:22.429028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:22.455441 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:22.603526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c959e4c97b944769bf210fb8ab24172'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.603970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb7306affa94e259c0be2ed774d29a1', 'request_id': 'req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.690353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c959e4c97b944769bf210fb8ab24172'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.691069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c959e4c97b944769bf210fb8ab24172'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.705938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c959e4c97b944769bf210fb8ab24172'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.706682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c959e4c97b944769bf210fb8ab24172'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.728426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1223/2469] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:22 2022] DELETE /identity/v3/users/3c959e4c97b944769bf210fb8ab24172 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:22.776390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb7306affa94e259c0be2ed774d29a1', 'request_id': 'req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.784376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb7306affa94e259c0be2ed774d29a1', 'request_id': 'req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.800991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] The token cache is being invalidate because project acb7306affa94e259c0be2ed774d29a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:22.801218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.801900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:22.803468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1247/2470] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:22 2022] DELETE /identity/v3/projects/acb7306affa94e259c0be2ed774d29a1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:22.905353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:22.906904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:22.929365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:23.006698 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312ca7d-da8b-44ad-9c1f-8675f01fb93d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:23.011766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:23.012755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.013036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.013310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] PATH_INFO: `/v3/users/48b5ab6a0c0440d380ad0b16722f60e7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.014504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b5ab6a0c0440d380ad0b16722f60e7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:23.016725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:23.247079 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b5ab6a0c0440d380ad0b16722f60e7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.297554 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:23.299644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:23.374020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f60ae-9be8-4ee6-8b75-b4f38453f0fd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:23.378659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:23.379529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.379812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.380113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] PATH_INFO: `/v3/projects/cc0221128be440aba041e37843f3f16b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.381370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0221128be440aba041e37843f3f16b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:23.383379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:23.390907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b5ab6a0c0440d380ad0b16722f60e7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.391768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b5ab6a0c0440d380ad0b16722f60e7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.405357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b5ab6a0c0440d380ad0b16722f60e7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.406059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-fa80b9df-e48b-4987-8753-d2a0f22b2b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b5ab6a0c0440d380ad0b16722f60e7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.418282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1224/2471] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:22 2022] DELETE /identity/v3/users/48b5ab6a0c0440d380ad0b16722f60e7 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:23.513198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0221128be440aba041e37843f3f16b', 'request_id': 'req-70985de1-0a0d-40a4-af06-663431b2b2bc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.598846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0221128be440aba041e37843f3f16b', 'request_id': 'req-70985de1-0a0d-40a4-af06-663431b2b2bc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.605907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0221128be440aba041e37843f3f16b', 'request_id': 'req-70985de1-0a0d-40a4-af06-663431b2b2bc'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.616529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] The token cache is being invalidate because project cc0221128be440aba041e37843f3f16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:23.616824 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.617478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.619178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1248/2472] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:23 2022] DELETE /identity/v3/projects/cc0221128be440aba041e37843f3f16b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:23.624946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a61f63-025d-4fd6-ad3d-669e7ac9ac8d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.625273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a61f63-025d-4fd6-ad3d-669e7ac9ac8d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.625579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a61f63-025d-4fd6-ad3d-669e7ac9ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.645567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-22a61f63-025d-4fd6-ad3d-669e7ac9ac8d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:23.648831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22a61f63-025d-4fd6-ad3d-669e7ac9ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:23.687851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:23.689650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:23.717839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1225/2473] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:23.724616 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.725444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.725922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.741143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:23.745058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:23.746287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:23.755179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1226/2474] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:23.759293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:23.766893 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985de1-0a0d-40a4-af06-663431b2b2bc admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:23.769623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be904c-1621-4f4c-bbaf-4c77743e43be None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:23.772210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:23.773095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.775048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.775048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] PATH_INFO: `/v3/projects/c3a5a8147b764c22b9c4037c7b8f5a6b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.775215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:23.775306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a5a8147b764c22b9c4037c7b8f5a6b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:23.775402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.775402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.775690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.776441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:23.776753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:23.776941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:23.778500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:23.790812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1227/2475] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:42:23.795520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:23.805634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485611-e093-4fed-9747-432f543f5991 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:23.811384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:23.812028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.812457 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.812735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.813414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:23.815303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:23.850590 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:23.905810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a5a8147b764c22b9c4037c7b8f5a6b', 'request_id': 'req-3f705a34-e66c-4f61-8471-9639dc6af387'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:23.924211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1228/2476] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:23 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:23.928262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:23.990099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eefef-abc3-44d3-95cd-f36f19533acf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:23.995122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:23.995805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:23.996089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:23.996394 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:23.997686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:23.999639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.010785 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a5a8147b764c22b9c4037c7b8f5a6b', 'request_id': 'req-3f705a34-e66c-4f61-8471-9639dc6af387'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.017778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a5a8147b764c22b9c4037c7b8f5a6b', 'request_id': 'req-3f705a34-e66c-4f61-8471-9639dc6af387'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.030550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] The token cache is being invalidate because project c3a5a8147b764c22b9c4037c7b8f5a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:24.030550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.031038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.032929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1249/2477] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:23 2022] DELETE /identity/v3/projects/c3a5a8147b764c22b9c4037c7b8f5a6b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:24.036517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.037854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:24.101817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705a34-e66c-4f61-8471-9639dc6af387 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.102220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1229/2478] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:23 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:24.106875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.107730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.108523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:24.108746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.109224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.109741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] PATH_INFO: `/v3/users/3c46f6351c71417cb68aaae7813082e0` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.111473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c46f6351c71417cb68aaae7813082e0)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.113477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.120991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd63924-17af-4c53-b299-644a4dbe2d3f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.126523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.127206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.127492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.127771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.128609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.133701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.141646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1230/2479] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:24.145702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.155626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbf6f3-f982-4b69-9fc9-86994ce3c7a8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.160286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.161007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.162384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.162384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.162384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.163903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.174950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1231/2480] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:24.178910 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.189060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904fdc8-bee3-4ed1-b28b-b7dd8f55f9dc admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.193650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748f57-c779-4942-af0d-fb4e3f904a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.194504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748f57-c779-4942-af0d-fb4e3f904a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.194940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748f57-c779-4942-af0d-fb4e3f904a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.195149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748f57-c779-4942-af0d-fb4e3f904a1f admin admin] PATH_INFO: `/v3/projects/5deb2ea26ec947a5ae4ecf0c1e63d610/users/1bd63d2e006848e9b22a31c5fc259012/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.219140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d748f57-c779-4942-af0d-fb4e3f904a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deb2ea26ec947a5ae4ecf0c1e63d610, user_id=1bd63d2e006848e9b22a31c5fc259012, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.221952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d748f57-c779-4942-af0d-fb4e3f904a1f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.406944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1232/2481] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:24 2022] PUT /identity/v3/projects/5deb2ea26ec947a5ae4ecf0c1e63d610/users/1bd63d2e006848e9b22a31c5fc259012/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:24.417321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.417602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.417888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.427173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c46f6351c71417cb68aaae7813082e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.459576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] MFA Rules not processed for user `1bd63d2e006848e9b22a31c5fc259012`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:24.459576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:24.514864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1233/2482] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:24.518789 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.547153 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:24.553209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c46f6351c71417cb68aaae7813082e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.553979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c46f6351c71417cb68aaae7813082e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.554849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c46f6351c71417cb68aaae7813082e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.569277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:24.571154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c46f6351c71417cb68aaae7813082e0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:24.591805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3242-dd14-4a17-9516-ede1ee7b3e68 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.592405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1250/2483] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:24 2022] DELETE /identity/v3/users/3c46f6351c71417cb68aaae7813082e0 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:24.651313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.651988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.652268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.652580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.654042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.655957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.770493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1234/2484] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:24 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:24.771638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.773109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:24.787962 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18627b3-ac7a-4f9e-9b31-341299845497 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.843310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.844043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.844306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.844614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.845326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.846799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:24.847452 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.848676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:24.871570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799ee0-294e-48aa-9647-b60362202efb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:24.877691 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:24.878516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:24.878812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:24.879103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] PATH_INFO: `/v3/projects/c40193da35b84b52b358238c6f847dc4` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:24.880248 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40193da35b84b52b358238c6f847dc4)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:24.882252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:24.991518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1251/2485] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:24 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:24.995691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:25.006296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f256-8de3-4ddc-bad4-101e9a99d171 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:25.011081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:25.011765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.012056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.014130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.014130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:25.015631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:25.026317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1252/2486] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:25.030738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:25.040753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3759aa-51e1-4ac4-9680-701f3a5525b1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:25.053293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40193da35b84b52b358238c6f847dc4', 'request_id': 'req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:25.059903 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40193da35b84b52b358238c6f847dc4', 'request_id': 'req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:25.066960 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40193da35b84b52b358238c6f847dc4', 'request_id': 'req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:25.100839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:25.101756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.102043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.102324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] PATH_INFO: `/v3/projects/c7bc325e3b014a0089648f6f3cabc050/users/72cc4edfa10d41e98ca4c524d827eeb5/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.119684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bc325e3b014a0089648f6f3cabc050, user_id=72cc4edfa10d41e98ca4c524d827eeb5, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:25.122932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:25.145665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] The token cache is being invalidate because project c40193da35b84b52b358238c6f847dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:25.145969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:25.146671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:25.148243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1235/2487] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:24 2022] DELETE /identity/v3/projects/c40193da35b84b52b358238c6f847dc4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:25.233167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1253/2488] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:25 2022] PUT /identity/v3/projects/c7bc325e3b014a0089648f6f3cabc050/users/72cc4edfa10d41e98ca4c524d827eeb5/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:25.237116 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:25.238964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:25.253271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224c7e-1864-42fe-bd0f-ca4f77d7faf6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:25.292438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:25.326052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccda2d-862f-49ff-a232-4b4fd445f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:25.326800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccda2d-862f-49ff-a232-4b4fd445f5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.327084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccda2d-862f-49ff-a232-4b4fd445f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.327366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccda2d-862f-49ff-a232-4b4fd445f5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.328121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccda2d-862f-49ff-a232-4b4fd445f5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:25.329889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccda2d-862f-49ff-a232-4b4fd445f5c4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:25.345338 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1236/2489] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:25.346635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:25.358836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781a1e-32f2-45c0-a50c-dc242607a610 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:25.364017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:25.364978 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.365260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.365541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] PATH_INFO: `/v3/projects/c7bc325e3b014a0089648f6f3cabc050/users/72cc4edfa10d41e98ca4c524d827eeb5/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.367869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bc325e3b014a0089648f6f3cabc050, user_id=72cc4edfa10d41e98ca4c524d827eeb5, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:25.370921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:25.384077 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1254/2490] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:25 2022] PUT /identity/v3/projects/c7bc325e3b014a0089648f6f3cabc050/users/72cc4edfa10d41e98ca4c524d827eeb5/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:25.396755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.397049 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.397331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.426914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] MFA Rules not processed for user `72cc4edfa10d41e98ca4c524d827eeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:25.428132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:25.500177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1237/2491] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:25.511760 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:25.513568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:25.554737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:25.573759 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0405-8d05-47b1-a445-55806dee9b41 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:25.577562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:25.578211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.578490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.578773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.588247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:25.589756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:25.599587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1255/2492] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:25.702262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:25.711899 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42979d-1856-416a-aecf-3cbe7b1a4595 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:25.716206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:25.716877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:25.717157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:25.717430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:25.719173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:25.777181 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:25.779099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f49ec-8aeb-4369-9def-7631d568d648 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:25.788114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1238/2493] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:29.073593 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:29.133244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f364-08ef-4080-841c-7be97836d9ee service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:29.138418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:29.139281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:29.139564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:29.139838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] PATH_INFO: `/v3/users/1bd63d2e006848e9b22a31c5fc259012` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:29.141282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd63d2e006848e9b22a31c5fc259012)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:29.143212 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:29.378532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd63d2e006848e9b22a31c5fc259012'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:29.447841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd63d2e006848e9b22a31c5fc259012'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:29.448492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd63d2e006848e9b22a31c5fc259012'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:29.449108 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd63d2e006848e9b22a31c5fc259012'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:29.462333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd63d2e006848e9b22a31c5fc259012'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:29.475301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1256/2494] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:29 2022] DELETE /identity/v3/users/1bd63d2e006848e9b22a31c5fc259012 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:29.479798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:29.480299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:29.480432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:29.497620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:29.498870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:29.549547 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:29.558695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1239/2495] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:29.569029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:29.570523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:29.628247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fcbc-941c-4086-9cec-5b9909aada3c admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:29.632997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:29.633658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:29.633944 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:29.634228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:29.644702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:29.646070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:29.651283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:29.656148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1257/2496] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:42:30.138931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:30.140400 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:30.157944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6895245-687d-4fc5-a725-f43d1a8bfefb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:30.157944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:30.158832 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:30.163918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:30.163918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] PATH_INFO: `/v3/projects/5deb2ea26ec947a5ae4ecf0c1e63d610` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:30.163918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5deb2ea26ec947a5ae4ecf0c1e63d610)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:30.163918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:30.292592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5deb2ea26ec947a5ae4ecf0c1e63d610', 'request_id': 'req-7412cbd2-c036-4edf-95c5-22bd7412136b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.299360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5deb2ea26ec947a5ae4ecf0c1e63d610', 'request_id': 'req-7412cbd2-c036-4edf-95c5-22bd7412136b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.307822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5deb2ea26ec947a5ae4ecf0c1e63d610', 'request_id': 'req-7412cbd2-c036-4edf-95c5-22bd7412136b'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.405098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] The token cache is being invalidate because project 5deb2ea26ec947a5ae4ecf0c1e63d610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:30.405324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.405968 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.407544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1240/2497] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:30 2022] DELETE /identity/v3/projects/5deb2ea26ec947a5ae4ecf0c1e63d610 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:30.411558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:30.421927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8a68-ae5a-4702-8faa-1c0e54bd92db service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:30.478545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:30.479463 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:30.479757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:30.480070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] PATH_INFO: `/v3/users/72cc4edfa10d41e98ca4c524d827eeb5` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:30.481973 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cc4edfa10d41e98ca4c524d827eeb5)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:30.483956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:30.679803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cc4edfa10d41e98ca4c524d827eeb5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.776482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cc4edfa10d41e98ca4c524d827eeb5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.777478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cc4edfa10d41e98ca4c524d827eeb5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.779058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cc4edfa10d41e98ca4c524d827eeb5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.793449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-57def88a-92f1-4df7-a93f-02663923bb1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cc4edfa10d41e98ca4c524d827eeb5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:30.810525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1258/2498] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:30 2022] DELETE /identity/v3/users/72cc4edfa10d41e98ca4c524d827eeb5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:31.268199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:31.269779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:31.282999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412cbd2-c036-4edf-95c5-22bd7412136b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:31.342164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:31.343037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:31.343323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:31.343603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] PATH_INFO: `/v3/projects/c7bc325e3b014a0089648f6f3cabc050` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:31.344824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bc325e3b014a0089648f6f3cabc050)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:31.346746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:31.449021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bc325e3b014a0089648f6f3cabc050', 'request_id': 'req-a953eb81-b9ed-439d-b539-b77c2dd0ae23'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:31.454543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bc325e3b014a0089648f6f3cabc050', 'request_id': 'req-a953eb81-b9ed-439d-b539-b77c2dd0ae23'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:31.460818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bc325e3b014a0089648f6f3cabc050', 'request_id': 'req-a953eb81-b9ed-439d-b539-b77c2dd0ae23'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:31.545665 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] The token cache is being invalidate because project c7bc325e3b014a0089648f6f3cabc050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:31.545970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:31.546604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a953eb81-b9ed-439d-b539-b77c2dd0ae23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:31.548241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1241/2499] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:31 2022] DELETE /identity/v3/projects/c7bc325e3b014a0089648f6f3cabc050 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:31.553368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:31.555338 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:31.555338 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:31.572848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:31.574106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:31.634634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1259/2500] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:31.642888 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:31.643179 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:31.643466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:31.661649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:31.662905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:31.671279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1242/2501] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:31.675492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:31.685729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ed033-9eee-4f1e-8a81-18c68b316634 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:31.690288 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:31.690938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:31.691222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:31.691499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:31.692223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:31.692566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:31.694194 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:31.705595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1260/2502] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:42:31.709877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:31.715508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:31.719783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b312b7-5b8c-44c2-838d-81f93be39839 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:31.724824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:31.726143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:31.726143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:31.726143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:31.726754 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:31.728727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:31.838504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1243/2503] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:31 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:31.843104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:31.853203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e53e-344a-40b3-82d2-63d33590d9a6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:31.857417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:31.909224 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:31.909895 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:31.910176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:31.910453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:31.911130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:31.913090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.134531 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1261/2504] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:31 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:32.139432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.151021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49bf2c-5b84-42c6-a553-42c844fb0bfa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.156241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.172099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.172099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.172099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.172099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.172099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.172099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1244/2505] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:32.174989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.185587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19dd60-9c90-4a8d-ad0b-5923e4ed0ccd admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.191105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331922c-9d19-4028-90ca-f37285aae06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.191780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331922c-9d19-4028-90ca-f37285aae06d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.192068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331922c-9d19-4028-90ca-f37285aae06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.192379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331922c-9d19-4028-90ca-f37285aae06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.193114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331922c-9d19-4028-90ca-f37285aae06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.194762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331922c-9d19-4028-90ca-f37285aae06d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.206055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1262/2506] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:32.210472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.221275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778bb62-ef9f-432f-92e0-4718bd61467b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.226350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.227253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.227540 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.227849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] PATH_INFO: `/v3/projects/ccb6655a862b4799a427109cf1829644/users/803d5b436a2a43ee89402a15995ca153/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.243875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb6655a862b4799a427109cf1829644, user_id=803d5b436a2a43ee89402a15995ca153, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.246569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.346065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1245/2507] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:32 2022] PUT /identity/v3/projects/ccb6655a862b4799a427109cf1829644/users/803d5b436a2a43ee89402a15995ca153/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:32.356542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.366673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.366673 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.383301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] MFA Rules not processed for user `803d5b436a2a43ee89402a15995ca153`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:32.384611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:32.453604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1263/2508] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:32.458102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.520182 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2589a-1a20-4bf9-8744-7bf32bb9254b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.524904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.525566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.525851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.526130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.526820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.528753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.611996 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.613911 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:32.644686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1246/2509] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:32 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:32.648524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.692938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25fd2e-7036-4604-9aa5-ced936c55e31 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.703362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:32.711672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcdda5-edc0-478f-a485-dc715ca0f4fb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.716494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.717159 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.717440 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.717716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.718436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.720366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.756848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.757506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.757790 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.758073 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.759907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:32.803795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1247/2510] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:32 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:32.805016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.815168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e85e-8a39-4bf9-89a9-bc81341c113f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.818239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.819926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.820114 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.820810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.821075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.821356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.822082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.824082 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.830090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1264/2511] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:42:32.834768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1248/2512] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:32.838905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.850026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a34f00-595d-4412-8740-e67708065492 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.854865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:32.855753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:32.856040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:32.856869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] PATH_INFO: `/v3/projects/dbd0d155b0854fa4a5edafd8ba28a7b6/users/b151319c9e0b454298644797b85f3651/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:32.872934 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd0d155b0854fa4a5edafd8ba28a7b6, user_id=b151319c9e0b454298644797b85f3651, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:32.879133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:32.965591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1265/2513] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:32 2022] PUT /identity/v3/projects/dbd0d155b0854fa4a5edafd8ba28a7b6/users/b151319c9e0b454298644797b85f3651/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:32.971434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:32.980559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edd48c-8bba-4f71-872e-d7c2c773acbf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:32.989173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:33.040078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf987723-465c-4399-a260-a5d2e8e135dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:33.040782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf987723-465c-4399-a260-a5d2e8e135dc admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:33.041065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf987723-465c-4399-a260-a5d2e8e135dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:33.041340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf987723-465c-4399-a260-a5d2e8e135dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:33.042052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf987723-465c-4399-a260-a5d2e8e135dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:33.043641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf987723-465c-4399-a260-a5d2e8e135dc admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:33.054042 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1249/2514] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:33.058222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:33.068976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3bdb8-7df0-4a54-8fb1-0e7bc7a7ee94 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:33.073709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:33.074624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:33.074838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:33.075152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] PATH_INFO: `/v3/projects/dbd0d155b0854fa4a5edafd8ba28a7b6/users/b151319c9e0b454298644797b85f3651/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:33.077144 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd0d155b0854fa4a5edafd8ba28a7b6, user_id=b151319c9e0b454298644797b85f3651, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:33.079786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:33.090254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1266/2515] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:33 2022] PUT /identity/v3/projects/dbd0d155b0854fa4a5edafd8ba28a7b6/users/b151319c9e0b454298644797b85f3651/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:33.107441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:33.107729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:33.108007 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:33.135956 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] MFA Rules not processed for user `b151319c9e0b454298644797b85f3651`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:33.137239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:33.205127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1250/2516] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:33.217038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:33.235665 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:33.278927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daf15b-cfa3-4dc1-8215-b324160d7463 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:33.282667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:33.283453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:33.283705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:33.283989 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:33.294500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:33.296045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:33.310391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1267/2517] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:33.613954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:33.615463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:33.627570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e8bcf-68bb-4f55-a679-841d59894f15 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:33.631228 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:33.631882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:33.632287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:33.632612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:33.690364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:33.691845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:33.701486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1251/2518] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:35.436019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:35.455015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:35.518901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7de48-f3c6-4328-95b4-11c4a074e05b service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:35.525098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:35.525761 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:35.526067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:35.526349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:35.528193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:35.593104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:35.594776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c3cb2-8715-4a36-ab52-99c666ab4aa4 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:35.607842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1268/2519] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:40.075593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:40.122468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:40.155040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b92e70-2c11-4fbc-bfac-4761cdd83c27 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:40.159861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:40.160818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:40.161104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:40.161383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] PATH_INFO: `/v3/users/803d5b436a2a43ee89402a15995ca153` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:40.162611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803d5b436a2a43ee89402a15995ca153)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:40.164653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:40.453764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803d5b436a2a43ee89402a15995ca153'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:40.603071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803d5b436a2a43ee89402a15995ca153'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:40.603824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803d5b436a2a43ee89402a15995ca153'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:40.617589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803d5b436a2a43ee89402a15995ca153'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:40.617803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803d5b436a2a43ee89402a15995ca153'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:40.630574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1252/2520] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:40 2022] DELETE /identity/v3/users/803d5b436a2a43ee89402a15995ca153 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:40.635507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:40.636031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:40.641365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:40.656772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:40.658029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:40.727946 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1269/2521] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:40.737984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:40.739534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:40.827978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd3fd-a8e5-44a8-8acb-0b40d32ca286 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:40.835358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:40.836526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:40.836870 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:40.837643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:40.851138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:40.853130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:40.865528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1253/2522] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:41.388141 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:41.399254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a52b4-9244-4c36-9a12-5ee017ef8486 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:41.403241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:41.415655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:41.415655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:41.415655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:41.415655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:41.421903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:41.423572 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:41.433048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1270/2523] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:41.481696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:41.485412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:41.507197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d334e-d9d9-4b15-bace-673af19e4e6c service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:41.517334 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:41.519048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:41.519353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:41.519817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] PATH_INFO: `/v3/projects/ccb6655a862b4799a427109cf1829644` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:41.522080 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb6655a862b4799a427109cf1829644)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:41.524802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:41.651326 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:41.654717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb6655a862b4799a427109cf1829644', 'request_id': 'req-c37f96ea-33ef-4f8a-9de2-1b3650745516'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:41.661234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb6655a862b4799a427109cf1829644', 'request_id': 'req-c37f96ea-33ef-4f8a-9de2-1b3650745516'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:41.672566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb6655a862b4799a427109cf1829644', 'request_id': 'req-c37f96ea-33ef-4f8a-9de2-1b3650745516'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:41.793442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] The token cache is being invalidate because project ccb6655a862b4799a427109cf1829644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:41.793736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:41.794949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:41.796558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1254/2524] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:41 2022] DELETE /identity/v3/projects/ccb6655a862b4799a427109cf1829644 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:41.800616 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:41.812489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7e2a3-953e-4430-b4ca-8863de4e67a7 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:41.863074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:41.893087 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:41.894242 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:41.894516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:41.894792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] PATH_INFO: `/v3/users/b151319c9e0b454298644797b85f3651` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:41.896171 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b151319c9e0b454298644797b85f3651)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:41.898181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:42.123583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b151319c9e0b454298644797b85f3651'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.214082 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b151319c9e0b454298644797b85f3651'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.214993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b151319c9e0b454298644797b85f3651'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.215716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b151319c9e0b454298644797b85f3651'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.229943 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-920f3ba6-d8ca-481a-9ce1-ef795edc7a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b151319c9e0b454298644797b85f3651'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.242175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1271/2525] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:41 2022] DELETE /identity/v3/users/b151319c9e0b454298644797b85f3651 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:42.718902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:42.722432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:42.741005 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f96ea-33ef-4f8a-9de2-1b3650745516 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:42.827233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:42.828143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:42.828496 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:42.828782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] PATH_INFO: `/v3/projects/dbd0d155b0854fa4a5edafd8ba28a7b6` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:42.830264 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd0d155b0854fa4a5edafd8ba28a7b6)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:42.832261 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:42.954189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd0d155b0854fa4a5edafd8ba28a7b6', 'request_id': 'req-d63efeab-0856-4f08-8cb8-9f37299d4880'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.959846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd0d155b0854fa4a5edafd8ba28a7b6', 'request_id': 'req-d63efeab-0856-4f08-8cb8-9f37299d4880'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:42.968459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd0d155b0854fa4a5edafd8ba28a7b6', 'request_id': 'req-d63efeab-0856-4f08-8cb8-9f37299d4880'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:43.140433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] The token cache is being invalidate because project dbd0d155b0854fa4a5edafd8ba28a7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:43.140759 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:43.141713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-d63efeab-0856-4f08-8cb8-9f37299d4880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:43.143218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1255/2526] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:42 2022] DELETE /identity/v3/projects/dbd0d155b0854fa4a5edafd8ba28a7b6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:43.148193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.148724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.148844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.168970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:43.170221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:43.232657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1272/2527] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:43.240821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.241138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.241414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.261947 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:43.263804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:43.272135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1256/2528] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:43.277296 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:43.293728 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83db6c-74a6-4e28-b514-28ec5dff39c8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:43.299119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:43.299958 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.300247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.300560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.301304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:43.301617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:43.303264 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:43.316481 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1273/2529] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:42:43.321855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:43.336095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9040c-a729-485d-93ea-adc3af23a46c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:43.340845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:43.341516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.341797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.342077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.342819 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:43.344782 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:43.485663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1257/2530] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:43 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:43.489966 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:43.500753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32943295-1763-4623-b4fe-7ed9494d4034 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:43.548813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:43.563021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:43.563715 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.563999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.564276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.565026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:43.566991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:43.675354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1274/2531] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:43 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:43.676895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:43.688027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272c2eb-7485-4bac-b558-8e86186756c1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:43.692857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:43.693531 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.693809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.694234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.694977 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:43.696638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:43.710224 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1258/2532] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:43.714307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:43.726306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1458e-1122-4302-b976-312aca43860b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:43.732663 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd3da-07f9-4543-9e21-6b9be1eaf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:43.733335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd3da-07f9-4543-9e21-6b9be1eaf0db admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.733636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd3da-07f9-4543-9e21-6b9be1eaf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.734008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd3da-07f9-4543-9e21-6b9be1eaf0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.734751 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd3da-07f9-4543-9e21-6b9be1eaf0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:43.736641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd3da-07f9-4543-9e21-6b9be1eaf0db admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:43.748833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1275/2533] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:43.753233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:43.763367 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0b89a-9be8-4bf4-8899-102d477bca61 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:43.768844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:43.769740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.770029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.770310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] PATH_INFO: `/v3/projects/41d827fc563645cb8396414f523d0f9f/users/a22d31ef43dd4a45b5731c33d7cda90c/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.787183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d827fc563645cb8396414f523d0f9f, user_id=a22d31ef43dd4a45b5731c33d7cda90c, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:43.790155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:43.793087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:43.863721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1259/2534] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:43 2022] PUT /identity/v3/projects/41d827fc563645cb8396414f523d0f9f/users/a22d31ef43dd4a45b5731c33d7cda90c/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:43.875479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:43.875780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:43.876063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:43.908231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] MFA Rules not processed for user `a22d31ef43dd4a45b5731c33d7cda90c`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:43.909505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:43.982987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1276/2535] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:43.987604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.053505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacafa5-fa1f-4e23-b29f-313ff7f8ba1b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.058382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.059054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.059342 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.059618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.060313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.062383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.270843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1260/2536] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:43 2022] POST /identity/v3/projects => generated 375 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:44.275248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.286648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39cf88-e639-4a22-a86e-55fd7552f4b6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.347114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.355500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.355500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.355500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.355500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.355500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.523788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1277/2537] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:44 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:44.527952 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.538868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef594fba-bb69-4409-8919-addd021f301d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.543685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.544436 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.550194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.550194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.550194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.550194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.558889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1261/2538] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:44.563577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.574346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b42812-5cc2-44e1-a4b5-3d2efa8f321f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.579841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f52251-3b56-4112-99f8-5780facd5bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.580542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f52251-3b56-4112-99f8-5780facd5bec admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.580828 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f52251-3b56-4112-99f8-5780facd5bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.581520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f52251-3b56-4112-99f8-5780facd5bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.581840 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f52251-3b56-4112-99f8-5780facd5bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.583455 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f52251-3b56-4112-99f8-5780facd5bec admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.594492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1278/2539] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:44.598604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.613295 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642498-e8b3-4fdb-94f2-67f1cb593179 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.618069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.618969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.619277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.619569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] PATH_INFO: `/v3/projects/b5dc8481bf344348bc4c5984930aee9f/users/4a80e7b8d6eb4212a1d7b0d218d64f4f/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.635424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dc8481bf344348bc4c5984930aee9f, user_id=4a80e7b8d6eb4212a1d7b0d218d64f4f, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.638684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.758008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1262/2540] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:44 2022] PUT /identity/v3/projects/b5dc8481bf344348bc4c5984930aee9f/users/4a80e7b8d6eb4212a1d7b0d218d64f4f/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:44.769851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.770149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.770439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.797422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] MFA Rules not processed for user `4a80e7b8d6eb4212a1d7b0d218d64f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:44.798569 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:44.818746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:44.867279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1279/2541] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:44.871802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.943515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2986c-c253-47c3-b22f-590e38167469 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.948671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.949388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.949671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.949984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.950731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.952716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.128896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1263/2542] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:42:44 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:45.134850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.147518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf012f-0adc-474e-9edd-2eb6d7463cb9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.218563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.219275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.219560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.219837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.220583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.222624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.427209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1280/2543] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:42:45 2022] POST /identity/v3/users => generated 295 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:45.434718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.443458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a097a9-5028-48f5-a801-475d8d465135 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.448513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.449198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.449482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.449762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.450505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.452915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.465713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1264/2544] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:45.470061 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.481654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a0a8-9191-4045-b484-8798f3dc0db7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.485448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.486352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.486630 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.486927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] PATH_INFO: `/v3/projects/940ce3be9a8d4b508112692a38f5dfea/users/37493c88b291485097902df6fa7b284d/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.508907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] RBAC: Authorizing `identity:create_grant(project_id=940ce3be9a8d4b508112692a38f5dfea, user_id=37493c88b291485097902df6fa7b284d, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.508907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.589270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1281/2545] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:45 2022] PUT /identity/v3/projects/940ce3be9a8d4b508112692a38f5dfea/users/37493c88b291485097902df6fa7b284d/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:45.594922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.605402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9383d-52e3-47bb-9c56-f1334f0511b6 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.620655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:45.666918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443508b4-5872-4bf9-9764-33e097b021cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.667596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443508b4-5872-4bf9-9764-33e097b021cd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.667882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443508b4-5872-4bf9-9764-33e097b021cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.668169 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443508b4-5872-4bf9-9764-33e097b021cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.669063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443508b4-5872-4bf9-9764-33e097b021cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.671098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443508b4-5872-4bf9-9764-33e097b021cd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.681775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1265/2546] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:45.687074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.697622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b355be-9303-4b42-a744-9a0254f4265f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.707867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.708854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.709142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.709434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] PATH_INFO: `/v3/projects/940ce3be9a8d4b508112692a38f5dfea/users/37493c88b291485097902df6fa7b284d/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.711532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=940ce3be9a8d4b508112692a38f5dfea, user_id=37493c88b291485097902df6fa7b284d, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.714501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.733721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1282/2547] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:42:45 2022] PUT /identity/v3/projects/940ce3be9a8d4b508112692a38f5dfea/users/37493c88b291485097902df6fa7b284d/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:45.740283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.740283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.740283 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.769683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] MFA Rules not processed for user `37493c88b291485097902df6fa7b284d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:45.771639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:45.851365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1266/2548] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:45.864207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.866071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:45.935821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15faf1f-6eaa-43af-878f-df5056b35fab admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.939926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.940638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.940924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.941200 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.975641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:46.006253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.008104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.018834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1283/2549] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:48.211141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:48.212679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:48.228931 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a1aa3-34f4-48bd-8b26-6bf96d856bf0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:48.234798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:48.236020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:48.236559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:48.237141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:48.314023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:48.315566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:48.326624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1267/2550] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:50.242343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:50.250975 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4b06-0524-454a-b9f1-3acae4bb64d1 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:50.254594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:50.255229 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:50.255516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:50.255798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:50.265655 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:50.267374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:50.277014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1284/2551] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:52.192075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.195502 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.253071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:52.321374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345341a-c54f-4ec0-b742-6e2194583ca6 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.329669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.330104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.330595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.331104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.334373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.362802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.365932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0e70-7b64-4891-bbc3-c0d47e610134 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.389680 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1268/2552] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:56.463007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:56.549783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1ecb2-3826-45f1-97c7-aa4a5bd92f98 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:56.562258 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:56.563256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.563547 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.563854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] PATH_INFO: `/v3/users/a22d31ef43dd4a45b5731c33d7cda90c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.565205 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22d31ef43dd4a45b5731c33d7cda90c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:56.567203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:56.829448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22d31ef43dd4a45b5731c33d7cda90c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.989062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22d31ef43dd4a45b5731c33d7cda90c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.989977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22d31ef43dd4a45b5731c33d7cda90c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.991232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22d31ef43dd4a45b5731c33d7cda90c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:57.014484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22d31ef43dd4a45b5731c33d7cda90c'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:57.023660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1285/2553] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:56 2022] DELETE /identity/v3/users/a22d31ef43dd4a45b5731c33d7cda90c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:57.028605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c139-b916-4f41-90a1-77dc823911ed None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.029104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c139-b916-4f41-90a1-77dc823911ed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.029340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c139-b916-4f41-90a1-77dc823911ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.048098 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7be6c139-b916-4f41-90a1-77dc823911ed None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:57.049371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7be6c139-b916-4f41-90a1-77dc823911ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.114585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1269/2554] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:57.125379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.127573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.174320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:57.195595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433911-8d5c-419c-93c4-ec9afdafdc93 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.200647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.201303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.201582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.201874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.211521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.213003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.223636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1286/2555] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:57.486867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.487157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.487435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.506911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:57.508239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.577411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1270/2556] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:42:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:57.590116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.592391 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.664788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9337d6-4c1c-4ff4-a310-2ae67c72d551 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.670175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.670832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.671118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.671522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.680165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.681822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.690101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1287/2557] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:42:57.765204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.766761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.782716 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf42ad0-7f6a-4f85-96f0-3705fa4ff217 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.787480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.788390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.788678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.788954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] PATH_INFO: `/v3/projects/41d827fc563645cb8396414f523d0f9f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.790156 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d827fc563645cb8396414f523d0f9f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.792077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.918896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d827fc563645cb8396414f523d0f9f', 'request_id': 'req-71ca0b26-eeea-426c-a657-9e4c1a7a313e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:57.926918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d827fc563645cb8396414f523d0f9f', 'request_id': 'req-71ca0b26-eeea-426c-a657-9e4c1a7a313e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:57.935607 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d827fc563645cb8396414f523d0f9f', 'request_id': 'req-71ca0b26-eeea-426c-a657-9e4c1a7a313e'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:57.937842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:58.080904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] The token cache is being invalidate because project 41d827fc563645cb8396414f523d0f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:58.081949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.082938 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.096845 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1271/2558] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:57 2022] DELETE /identity/v3/projects/41d827fc563645cb8396414f523d0f9f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:58.102394 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:58.118939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ad090-cee9-4e14-a554-292c3aa2f3ba service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:58.218609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:58.219652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:58.220080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:58.220359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] PATH_INFO: `/v3/users/4a80e7b8d6eb4212a1d7b0d218d64f4f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:58.221802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a80e7b8d6eb4212a1d7b0d218d64f4f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:58.223830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:58.309934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:58.312682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:58.400912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0b26-eeea-426c-a657-9e4c1a7a313e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:58.420688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:58.420688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:58.420688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:58.420688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:58.422559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:58.441551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:58.443706 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:58.463703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1272/2559] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:42:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:42:58.621995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a80e7b8d6eb4212a1d7b0d218d64f4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.749826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a80e7b8d6eb4212a1d7b0d218d64f4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.750507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a80e7b8d6eb4212a1d7b0d218d64f4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.751139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a80e7b8d6eb4212a1d7b0d218d64f4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.765226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:58.771316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a80e7b8d6eb4212a1d7b0d218d64f4f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.784919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1288/2560] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:42:58 2022] DELETE /identity/v3/users/4a80e7b8d6eb4212a1d7b0d218d64f4f => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:59.846476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.849003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:59.867681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41fd3f-7212-40be-a9b3-e30911ec2979 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.955732 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.956811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.957163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.957523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] PATH_INFO: `/v3/projects/b5dc8481bf344348bc4c5984930aee9f` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.958856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dc8481bf344348bc4c5984930aee9f)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.961154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.057951 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.059632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:00.132869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698302a5-d40d-4272-887a-cf623e1aae44 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.136754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.137429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.137772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.138055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.140510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:00.156626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.158106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.175482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1289/2561] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:43:00.195492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dc8481bf344348bc4c5984930aee9f', 'request_id': 'req-0c99a277-512b-4644-b8bb-53ce8e49ff89'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:00.203031 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dc8481bf344348bc4c5984930aee9f', 'request_id': 'req-0c99a277-512b-4644-b8bb-53ce8e49ff89'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:00.216086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dc8481bf344348bc4c5984930aee9f', 'request_id': 'req-0c99a277-512b-4644-b8bb-53ce8e49ff89'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:00.338083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] The token cache is being invalidate because project b5dc8481bf344348bc4c5984930aee9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:00.338526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:00.339772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:00.341662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1273/2562] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:42:59 2022] DELETE /identity/v3/projects/b5dc8481bf344348bc4c5984930aee9f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:00.345230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.347389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:00.361548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406a48a-f938-4fc5-a75e-306057e6d25f service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.459558 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.461475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.461988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.462493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] PATH_INFO: `/v3/users/37493c88b291485097902df6fa7b284d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.468124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37493c88b291485097902df6fa7b284d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.472459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.732936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37493c88b291485097902df6fa7b284d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:01.097781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37493c88b291485097902df6fa7b284d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:01.098915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37493c88b291485097902df6fa7b284d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:01.099646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37493c88b291485097902df6fa7b284d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:01.114485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-ab9e9014-ad38-4366-9e64-1b2fd6ef7822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37493c88b291485097902df6fa7b284d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:01.130297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1290/2563] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:43:00 2022] DELETE /identity/v3/users/37493c88b291485097902df6fa7b284d => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:01.791327 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:01.792842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:01.816434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99a277-512b-4644-b8bb-53ce8e49ff89 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:01.824773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:01.903891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:01.905689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:01.907779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:01.907779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] PATH_INFO: `/v3/projects/940ce3be9a8d4b508112692a38f5dfea` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:01.908501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940ce3be9a8d4b508112692a38f5dfea)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:01.910448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.146825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940ce3be9a8d4b508112692a38f5dfea', 'request_id': 'req-7a49d973-8a07-4e0b-85fa-80c244b32df5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:02.156335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940ce3be9a8d4b508112692a38f5dfea', 'request_id': 'req-7a49d973-8a07-4e0b-85fa-80c244b32df5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:02.170939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940ce3be9a8d4b508112692a38f5dfea', 'request_id': 'req-7a49d973-8a07-4e0b-85fa-80c244b32df5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:02.311704 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] The token cache is being invalidate because project 940ce3be9a8d4b508112692a38f5dfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:02.312155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:02.313442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7a49d973-8a07-4e0b-85fa-80c244b32df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:02.317268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1274/2564] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:43:01 2022] DELETE /identity/v3/projects/940ce3be9a8d4b508112692a38f5dfea => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:02.322086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.322898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.323366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.346737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:02.348282 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:02.353849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:02.426128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1291/2565] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:02.433978 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.434416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.434798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.480576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:02.481990 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:02.500202 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1275/2566] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:02.501310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:02.519960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187d3e-5d16-47e9-a17e-7696827ff758 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:02.528001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:02.528744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.529659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.529999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.531462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:43:02.532079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:02.536648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.552386 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1292/2567] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:43:02.556981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:02.568941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee385d-f8fd-4dc3-be43-baf0b15f5de5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:02.576860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:02.577777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.578247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.578482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.579223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:02.582409 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.693044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1276/2568] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:43:02 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:02.697885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:02.711650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64720ae-5531-4b85-a220-025d9eca4280 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:02.812661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:02.813689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.813933 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.814318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.815166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:02.817413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.905366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1293/2569] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:43:02 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:02.910658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:02.923120 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dd847-877f-46ad-b226-a6257b2ec2e0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:02.928420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:02.929158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.934325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.934886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.936062 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:02.938057 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.962819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:02.973932 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1277/2570] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:02.983020 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1359c2-61ab-4892-aae7-8d20f19c2787 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:02.992497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5fd26-64de-421b-94da-8c32df59d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:02.993565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5fd26-64de-421b-94da-8c32df59d135 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.994051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5fd26-64de-421b-94da-8c32df59d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.994706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5fd26-64de-421b-94da-8c32df59d135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.996014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5fd26-64de-421b-94da-8c32df59d135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:03.002980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5fd26-64de-421b-94da-8c32df59d135 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:03.023178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1294/2571] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:03.023814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:03.038731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1997f-4350-416b-b1c6-108a9e33b74e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:03.043528 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:03.044688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:03.045018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:03.049306 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] PATH_INFO: `/v3/projects/f1039101ba1b4429a8a7f979179d5f79/users/ed4c9495e16d4707bda60a5ad36d05c7/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:03.073633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1039101ba1b4429a8a7f979179d5f79, user_id=ed4c9495e16d4707bda60a5ad36d05c7, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:03.079619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:03.162246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1278/2572] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:43:03 2022] PUT /identity/v3/projects/f1039101ba1b4429a8a7f979179d5f79/users/ed4c9495e16d4707bda60a5ad36d05c7/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:03.172993 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:03.173320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:03.173562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:03.206651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] MFA Rules not processed for user `ed4c9495e16d4707bda60a5ad36d05c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:03.208842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:03.356646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:03.359131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:03.361190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1295/2573] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:03.451650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:03.501584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05072-3c48-4f94-b65e-28683fae57c4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:03.511382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:03.512154 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:03.512543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:03.513155 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:03.530683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:03.533380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:03.547515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1279/2574] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:05.594013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:05.594013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:05.599795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:05.661396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726c4d0-59ec-4b0c-bb5d-52a61ffd60f4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:05.666096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:05.667150 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:05.667493 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:05.667738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] PATH_INFO: `/v3/users/415775dc8e6a484d8894bdeaab4da631` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:05.668976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415775dc8e6a484d8894bdeaab4da631)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:05.670999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:05.848345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415775dc8e6a484d8894bdeaab4da631'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:05.949197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415775dc8e6a484d8894bdeaab4da631'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:05.949849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415775dc8e6a484d8894bdeaab4da631'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:05.950936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415775dc8e6a484d8894bdeaab4da631'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:05.974781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-e80262f0-1f15-413e-8e57-7da2b4f2c130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415775dc8e6a484d8894bdeaab4da631'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:05.992807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1296/2575] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:43:05 2022] DELETE /identity/v3/users/415775dc8e6a484d8894bdeaab4da631 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:06.403149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:06.429629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15f3b-7f3c-4b6d-a9db-54a2552a3a8c service glance] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:06.572679 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:06.573612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:06.573897 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:06.574177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] PATH_INFO: `/v3/projects/adc4f78ff2f141c3b1bd4a1a10a85e38` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:06.575399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc4f78ff2f141c3b1bd4a1a10a85e38)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:06.577908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:06.720692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc4f78ff2f141c3b1bd4a1a10a85e38', 'request_id': 'req-f107c035-c202-48ef-88ac-b2e3ed2217fa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:06.729285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc4f78ff2f141c3b1bd4a1a10a85e38', 'request_id': 'req-f107c035-c202-48ef-88ac-b2e3ed2217fa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:06.737111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc4f78ff2f141c3b1bd4a1a10a85e38', 'request_id': 'req-f107c035-c202-48ef-88ac-b2e3ed2217fa'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:06.829552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] The token cache is being invalidate because project adc4f78ff2f141c3b1bd4a1a10a85e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:06.829944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:06.830777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f107c035-c202-48ef-88ac-b2e3ed2217fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:06.834448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1280/2576] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:43:06 2022] DELETE /identity/v3/projects/adc4f78ff2f141c3b1bd4a1a10a85e38 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:06.843741 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:06.844270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:06.844438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:06.871874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:06.873534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:06.987187 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1297/2577] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:43:06.995615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:06.995886 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:06.996165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.020077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:07.021644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:07.030434 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1281/2578] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:43:07.035110 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.051343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba984916-1262-46f0-9b9c-11cd1e1e9c51 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.060149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.061696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.062605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.063354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.064111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:43:07.064582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.066232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.080297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1298/2579] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:43:07.087687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.101465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a08f0-93be-4204-a4d1-fab2bcb1900f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.107413 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.108420 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.108725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.109010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.109773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.111847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.272828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1282/2580] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:43:07 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:07.274798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.287915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93103-687f-4e3d-9e06-109468465122 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.317089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:07.395932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.403428 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.405771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.406462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.409816 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.418178 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.528605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1299/2581] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:43:07 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:07.533045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.549366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0843ad-f9c9-499c-b6b4-17dbcbf67aaf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.554839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.556178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.556744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.559986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.562979 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.565108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.600406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1283/2582] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:07.607129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.633702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c6714-6157-4508-9f35-01586b905ee9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.646782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986630d-6de2-4c18-b957-e5cb20ff0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.651674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986630d-6de2-4c18-b957-e5cb20ff0e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.651674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986630d-6de2-4c18-b957-e5cb20ff0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.651674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986630d-6de2-4c18-b957-e5cb20ff0e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.651674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986630d-6de2-4c18-b957-e5cb20ff0e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.655466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986630d-6de2-4c18-b957-e5cb20ff0e09 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.670942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1300/2583] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:07.675810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.688065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a75e0a-b877-4a9e-931b-b21d151fca1e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.694766 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.696178 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.696744 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.697239 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] PATH_INFO: `/v3/projects/17ee4872b216425cbc6e3515dd1e26f1/users/12c7dcba864c4f5ebb3ca8c428b1e9a7/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.722296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ee4872b216425cbc6e3515dd1e26f1, user_id=12c7dcba864c4f5ebb3ca8c428b1e9a7, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.727922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.959060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1284/2584] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:43:07 2022] PUT /identity/v3/projects/17ee4872b216425cbc6e3515dd1e26f1/users/12c7dcba864c4f5ebb3ca8c428b1e9a7/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:07.964697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275062e-5b50-4606-9365-83b2e2b037cb None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.965271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275062e-5b50-4606-9365-83b2e2b037cb None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.965271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275062e-5b50-4606-9365-83b2e2b037cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:08.003085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-6275062e-5b50-4606-9365-83b2e2b037cb None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:08.004497 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-6275062e-5b50-4606-9365-83b2e2b037cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:08.082883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1301/2585] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:08.093158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:08.095737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:08.101791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:08.187472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52389de5-b6c1-43e2-a1cd-5d30ee568097 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:08.192035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:08.195294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:08.195294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:08.196841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:08.208663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:08.210220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:08.224517 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1285/2586] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:15.730772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:15.732449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:15.732449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:15.761650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] MFA Rules not processed for user `12c7dcba864c4f5ebb3ca8c428b1e9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:15.762918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:15.851820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1302/2587] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:15.866297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:15.867745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:15.952249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff7b6-ee3d-4ff9-98e0-3de94bbf2294 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:15.957705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:15.958941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:15.959213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:15.959494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:15.969671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:15.971359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:15.985360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1286/2588] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:17.876629 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:17.886692 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b5a4-0847-405d-b096-b20dd697a070 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:17.892987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:17.892987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:17.892987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:17.892987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:17.894439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:17.904701 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:17.906645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af92c9-756a-4476-bcec-5e1c8e4366fb service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:17.915139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1303/2589] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:19.010755 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.012214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.097190 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b2df2-96f9-4d6b-94d2-256825476c35 service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.103505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.104527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.104908 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.114955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.114955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.120862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.122623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3d015-f214-4ed6-9034-1688b7851860 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.142022 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1287/2590] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:19.257457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.257984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.259609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.278804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:19.287831 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] MFA Rules not processed for user `12c7dcba864c4f5ebb3ca8c428b1e9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:19.289173 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.297230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1304/2591] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:21.656811 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:21.657351 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:21.657613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:21.676448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:21.677684 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:21.692702 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:21.737619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1288/2592] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:43:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:21.759422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:21.760871 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:21.830228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5162312-693b-4110-99f8-58b1ab0f28fc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:21.835169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12561a8-23e8-4996-967a-2c30ef1c1062 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:21.835823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12561a8-23e8-4996-967a-2c30ef1c1062 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:21.836134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12561a8-23e8-4996-967a-2c30ef1c1062 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:21.836530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12561a8-23e8-4996-967a-2c30ef1c1062 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:21.845003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12561a8-23e8-4996-967a-2c30ef1c1062 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:21.846588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12561a8-23e8-4996-967a-2c30ef1c1062 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:21.855145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1305/2593] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:43:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:31.750312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=16 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.852469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=32 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:32.807984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.809694 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:32.824113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ab8f1-33f4-49ca-bf3b-c4f5d131668f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.829710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.830593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.830874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.831201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] PATH_INFO: `/v3/users/ed4c9495e16d4707bda60a5ad36d05c7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.832493 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4c9495e16d4707bda60a5ad36d05c7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.834414 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:33.224650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4c9495e16d4707bda60a5ad36d05c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:33.366593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4c9495e16d4707bda60a5ad36d05c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:33.367297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4c9495e16d4707bda60a5ad36d05c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:33.382279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4c9495e16d4707bda60a5ad36d05c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:33.390044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4c9495e16d4707bda60a5ad36d05c7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:33.397929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1289/2594] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:43:32 2022] DELETE /identity/v3/users/ed4c9495e16d4707bda60a5ad36d05c7 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:33.402232 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:33.402740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:33.402855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:33.420726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:33.422071 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:33.483125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1306/2595] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:33.492965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:33.494557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:33.557829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad27060-e9e9-4e61-bf07-67bff1ab082f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:33.562241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209360b-1579-4e8f-bed7-1f71be143a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:33.562904 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209360b-1579-4e8f-bed7-1f71be143a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:33.563191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209360b-1579-4e8f-bed7-1f71be143a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:33.563475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209360b-1579-4e8f-bed7-1f71be143a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:33.573604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209360b-1579-4e8f-bed7-1f71be143a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:33.575102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209360b-1579-4e8f-bed7-1f71be143a2a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:33.585896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1290/2596] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:34.996651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:34.998416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:35.015189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24680-ba0b-4420-9094-08600b4b51c4 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:35.021491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:35.022469 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:35.022823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:35.023174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] PATH_INFO: `/v3/projects/f1039101ba1b4429a8a7f979179d5f79` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:35.024714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1039101ba1b4429a8a7f979179d5f79)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:35.026980 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:35.274145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1039101ba1b4429a8a7f979179d5f79', 'request_id': 'req-d47d9d99-59c4-485b-9616-25a604a2fd77'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:35.398928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1039101ba1b4429a8a7f979179d5f79', 'request_id': 'req-d47d9d99-59c4-485b-9616-25a604a2fd77'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:35.407022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1039101ba1b4429a8a7f979179d5f79', 'request_id': 'req-d47d9d99-59c4-485b-9616-25a604a2fd77'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:35.419915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] The token cache is being invalidate because project f1039101ba1b4429a8a7f979179d5f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:35.420272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:35.421480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-d47d9d99-59c4-485b-9616-25a604a2fd77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:35.426355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1307/2597] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:43:34 2022] DELETE /identity/v3/projects/f1039101ba1b4429a8a7f979179d5f79 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:35.428757 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:35.429255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:35.429360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:35.452065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:35.455419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:35.524715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1291/2598] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:35.533997 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:35.535648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:35.535648 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:35.553606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:35.554857 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:35.563724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1308/2599] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:35.567666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:35.577991 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a61d0-a5a8-4956-a366-f88cc0237a25 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:35.582964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:35.583586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:35.585532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:35.585532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:35.585532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:43:35.585532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:35.586791 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:35.600709 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1292/2600] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:43:35.604859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:35.615309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c6a7f-9caa-433f-8662-bdf6d8be8c93 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:35.620069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:35.620755 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:35.621042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:35.621320 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:35.622056 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:35.623984 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:35.883085 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1309/2601] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:43:35 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:35.887253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:35.893012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:35.898454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a873a04-4a3d-4cee-93b2-1574d7df2d12 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:35.954419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:35.955029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:35.955308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:35.955609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:35.956304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:35.958268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:36.199541 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1293/2602] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:43:35 2022] POST /identity/v3/users => generated 285 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:36.218754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:36.228953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad12051-2931-4a62-b395-15c597bfb393 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:36.233738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:36.234453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:36.234734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:36.235021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:36.235781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:36.237560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:36.249356 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1310/2603] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:36.253407 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:36.263328 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f6442-9c51-42d8-8d3b-729eb7290313 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:36.268730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92415e-691e-4bcd-b257-539e1f7cfd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:36.269385 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92415e-691e-4bcd-b257-539e1f7cfd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:36.269670 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92415e-691e-4bcd-b257-539e1f7cfd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:36.269959 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92415e-691e-4bcd-b257-539e1f7cfd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:36.270675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92415e-691e-4bcd-b257-539e1f7cfd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:36.272274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92415e-691e-4bcd-b257-539e1f7cfd1d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:36.286707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1294/2604] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:36.290092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:36.302126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c34e1-b829-478c-af2a-12210185c984 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:36.308494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:36.309501 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:36.309853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:36.310185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] PATH_INFO: `/v3/projects/da0e51d6313d4f53b5b31a416e381387/users/8613c030a116496c9f5b8fbe51942cd7/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:36.327699 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0e51d6313d4f53b5b31a416e381387, user_id=8613c030a116496c9f5b8fbe51942cd7, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:36.330499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:36.490304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1311/2605] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:43:36 2022] PUT /identity/v3/projects/da0e51d6313d4f53b5b31a416e381387/users/8613c030a116496c9f5b8fbe51942cd7/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:36.495175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aacafd-3fd1-478f-b432-c4774793faf2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:36.495671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aacafd-3fd1-478f-b432-c4774793faf2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:36.495777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aacafd-3fd1-478f-b432-c4774793faf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:36.525329 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a8aacafd-3fd1-478f-b432-c4774793faf2 None None] MFA Rules not processed for user `8613c030a116496c9f5b8fbe51942cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:36.526605 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a8aacafd-3fd1-478f-b432-c4774793faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:36.594386 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1295/2606] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:36.606361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:36.607982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:36.631151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:36.673803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7960d2-b580-47bd-8cfd-9697891ca58d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:36.678364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4af657aef94d1abff7bc9c10264832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:36.679166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:36.679533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:36.679814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:36.689985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:36.691453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:36.701408 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1312/2607] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:38.342520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:38.343033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:38.346165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:38.362608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:38.364247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:38.437101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1296/2608] 10.222.0.67 () {58 vars in 967 bytes} [Fri May 27 09:43:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:38.450577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:38.452780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:38.529818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5473-2a05-44d5-b3b7-f4d1c5b013c3 service glance] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:38.535433 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:38.536090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:38.536403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:38.536683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:38.547706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:38.549281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:38.557718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1313/2609] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:44.699974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:44.701529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:44.723520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:44.781731 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31dcfa-7d0f-40b6-aae4-5811a968eeb6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:44.787226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:44.787881 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:44.788176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:44.788492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:44.790287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:44.803381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:44.804921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cbfd-3796-4ce7-a114-4f2862db3bd8 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:44.817292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1297/2610] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:48.557712 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=49 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:54.812480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=27 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:02.556480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:02.617643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970cc8-71ce-4e67-954a-7d018824b616 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:02.622532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:02.623424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:02.623716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:02.623995 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] PATH_INFO: `/v3/users/8613c030a116496c9f5b8fbe51942cd7` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:02.625256 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8613c030a116496c9f5b8fbe51942cd7)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:02.627704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:02.816890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8613c030a116496c9f5b8fbe51942cd7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:02.893167 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8613c030a116496c9f5b8fbe51942cd7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:02.894055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8613c030a116496c9f5b8fbe51942cd7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:02.894700 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8613c030a116496c9f5b8fbe51942cd7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:02.908625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8613c030a116496c9f5b8fbe51942cd7'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:02.921089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1314/2611] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:44:02 2022] DELETE /identity/v3/users/8613c030a116496c9f5b8fbe51942cd7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:02.926352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:02.927173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:02.927173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:02.945362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:02.946587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:03.010091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1298/2612] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:03.020279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:03.021789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:03.081400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b716e-619f-4f97-b989-a32899af18bf admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:03.085732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6aeca-cd73-4577-bd90-43f9950e60f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:03.086425 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6aeca-cd73-4577-bd90-43f9950e60f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:03.086708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6aeca-cd73-4577-bd90-43f9950e60f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:03.086988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6aeca-cd73-4577-bd90-43f9950e60f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:03.098209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6aeca-cd73-4577-bd90-43f9950e60f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:03.099682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6aeca-cd73-4577-bd90-43f9950e60f1 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:03.110736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1315/2613] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:03.521318 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:03.522772 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:03.536006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324861ad-f72e-4801-a2dd-0e5d0087b594 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:03.540839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:03.548771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:03.548771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:03.548771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] PATH_INFO: `/v3/projects/da0e51d6313d4f53b5b31a416e381387` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:03.548771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0e51d6313d4f53b5b31a416e381387)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:03.548771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:03.643371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0e51d6313d4f53b5b31a416e381387', 'request_id': 'req-70a32971-cbef-4d1d-9acf-2ef0f89f1819'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:03.649059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0e51d6313d4f53b5b31a416e381387', 'request_id': 'req-70a32971-cbef-4d1d-9acf-2ef0f89f1819'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:03.655924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0e51d6313d4f53b5b31a416e381387', 'request_id': 'req-70a32971-cbef-4d1d-9acf-2ef0f89f1819'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:03.779623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] The token cache is being invalidate because project da0e51d6313d4f53b5b31a416e381387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:44:03.779913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:03.780623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-70a32971-cbef-4d1d-9acf-2ef0f89f1819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:03.782274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1299/2614] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:44:03 2022] DELETE /identity/v3/projects/da0e51d6313d4f53b5b31a416e381387 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:03.788045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:03.788738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:03.788879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:03.811189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:03.812476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:03.832965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:03.885490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1316/2615] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:44:03.895717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:03.896277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:03.896857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:03.919132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:03.920512 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:03.929198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1300/2616] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:03.934140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:03.945490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708687-e393-44e9-b16c-03e6ff20e2c0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:03.950921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:03.951635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:03.951927 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:03.952210 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:03.952999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:44:03.953314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:03.955560 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:03.968797 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1317/2617] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:44:03.973987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:03.983854 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899b9f-2b4b-4040-b6f9-3718937c1715 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:03.988674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:03.989350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:03.989643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:03.989924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:03.990615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:03.992563 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:04.076416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1301/2618] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:44:03 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:04.081120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:04.091939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeddad-0764-4564-ba3a-f6cdb1292aec admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:04.149613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:04.150208 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.150491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.150775 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.151479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:04.153679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:04.285721 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1318/2619] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:44:04 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:04.290047 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:04.301064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93f3db-3680-4df3-81ea-f294a2773b6b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:04.306622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:04.307330 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.307613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.307892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.308683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:04.310354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:04.322464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1302/2620] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:04.328355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:04.338610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f0788-c46c-40ec-8539-d1a5ea6582c6 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:04.343559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783651-1956-47b3-a065-ab1594f45bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:04.344223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783651-1956-47b3-a065-ab1594f45bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.344545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783651-1956-47b3-a065-ab1594f45bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.344827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783651-1956-47b3-a065-ab1594f45bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.345587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783651-1956-47b3-a065-ab1594f45bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:04.347214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783651-1956-47b3-a065-ab1594f45bf0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:04.357734 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1319/2621] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:04.362674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:04.377637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c06c-1df0-44f9-a775-5ceafb10a7cd admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:04.383372 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:04.384267 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.384597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.384879 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] PATH_INFO: `/v3/projects/8bd7a06d69eb4b468d14c3d4615f3edc/users/ba5d3cdfe8e149deb6641a69dd1d7406/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.401611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd7a06d69eb4b468d14c3d4615f3edc, user_id=ba5d3cdfe8e149deb6641a69dd1d7406, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:04.404587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:04.486767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1303/2622] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:44:04 2022] PUT /identity/v3/projects/8bd7a06d69eb4b468d14c3d4615f3edc/users/ba5d3cdfe8e149deb6641a69dd1d7406/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:04.571938 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.572241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.572542 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.602199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] MFA Rules not processed for user `ba5d3cdfe8e149deb6641a69dd1d7406`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:04.603559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:04.678793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1320/2623] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:04.690598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:04.692346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:04.714629 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:04.755689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e715448-b092-40ce-99db-3977e881a1cf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:04.767859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df583e7-1266-4993-87aa-876cda318302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:04.768661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df583e7-1266-4993-87aa-876cda318302 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.769251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df583e7-1266-4993-87aa-876cda318302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.769571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df583e7-1266-4993-87aa-876cda318302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.780454 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df583e7-1266-4993-87aa-876cda318302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:04.781825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df583e7-1266-4993-87aa-876cda318302 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:04.792313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1304/2624] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:04.818140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:04.838832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:04.885959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dbd8f-9eb8-442f-861e-9b1ff242cf36 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:04.890813 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:04.891800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:04.892090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:04.892403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] PATH_INFO: `/v3/users/ba5d3cdfe8e149deb6641a69dd1d7406` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:04.893641 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5d3cdfe8e149deb6641a69dd1d7406)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:04.895917 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:05.127668 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5d3cdfe8e149deb6641a69dd1d7406'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:05.216300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5d3cdfe8e149deb6641a69dd1d7406'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:05.217060 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5d3cdfe8e149deb6641a69dd1d7406'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:05.217713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5d3cdfe8e149deb6641a69dd1d7406'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:05.232140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5d3cdfe8e149deb6641a69dd1d7406'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:05.245803 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1321/2625] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:44:04 2022] DELETE /identity/v3/users/ba5d3cdfe8e149deb6641a69dd1d7406 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:05.249718 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:05.254992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:05.254992 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:05.268274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:05.270172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:05.330677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1305/2626] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:05.340475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:05.342051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:05.399687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef692ea-c73b-4072-b93a-ae53f1bfe883 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:05.403226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f988e7-1f5e-4e8f-afd1-7a27835e20c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:05.403881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f988e7-1f5e-4e8f-afd1-7a27835e20c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:05.404158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f988e7-1f5e-4e8f-afd1-7a27835e20c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:05.404471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f988e7-1f5e-4e8f-afd1-7a27835e20c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:05.414506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f988e7-1f5e-4e8f-afd1-7a27835e20c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:05.415935 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f988e7-1f5e-4e8f-afd1-7a27835e20c3 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:05.425489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1322/2627] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:05.903715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:05.903715 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:05.916600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327325f-12d3-46ea-a0f0-7c0df1b32870 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:05.921627 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:05.922529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:05.923320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:05.923598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] PATH_INFO: `/v3/projects/8bd7a06d69eb4b468d14c3d4615f3edc` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:05.924892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd7a06d69eb4b468d14c3d4615f3edc)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:05.926844 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:06.074380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd7a06d69eb4b468d14c3d4615f3edc', 'request_id': 'req-7f264dc3-579a-49da-ae00-89d26ba00ba5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:06.081249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd7a06d69eb4b468d14c3d4615f3edc', 'request_id': 'req-7f264dc3-579a-49da-ae00-89d26ba00ba5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:06.090835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd7a06d69eb4b468d14c3d4615f3edc', 'request_id': 'req-7f264dc3-579a-49da-ae00-89d26ba00ba5'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:06.179466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] The token cache is being invalidate because project 8bd7a06d69eb4b468d14c3d4615f3edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:44:06.179666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:06.180389 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:06.181961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1306/2628] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:44:05 2022] DELETE /identity/v3/projects/8bd7a06d69eb4b468d14c3d4615f3edc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:15.421153 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:16.176140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:28.880016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:28.880016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:28.880016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:28.884783 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:28.886284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:28.899826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] MFA Rules not processed for user `12c7dcba864c4f5ebb3ca8c428b1e9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:28.901271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:28.957078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264dc3-579a-49da-ae00-89d26ba00ba5 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:28.964234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:28.965010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1323/2629] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:28.965148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:28.965268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:28.965478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:28.967381 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:29.039736 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:29.041354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:29.054298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1307/2630] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:44:33.594548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:33.596826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:33.612084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e92a5-78e2-40ab-8c33-537876330416 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:33.617539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:33.618720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:33.619096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:33.619472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] PATH_INFO: `/v3/users/9e8aada8bb9642319ea99af1f98b9f70` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:33.621454 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8aada8bb9642319ea99af1f98b9f70)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:33.624046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:33.852435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8aada8bb9642319ea99af1f98b9f70'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:33.973195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8aada8bb9642319ea99af1f98b9f70'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:33.973802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8aada8bb9642319ea99af1f98b9f70'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:33.974412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8aada8bb9642319ea99af1f98b9f70'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:33.987711 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-7c131868-605b-40b3-8c6b-55f8f0fa13dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8aada8bb9642319ea99af1f98b9f70'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:34.003804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1324/2631] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:44:33 2022] DELETE /identity/v3/users/9e8aada8bb9642319ea99af1f98b9f70 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:44:34.261603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:34.284288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff795b75-120b-4908-815f-b7791d0b3a27 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:34.373452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:34.374638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:34.374920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:34.375192 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] PATH_INFO: `/v3/projects/198c7fd541c549808b949d77fb74afc0` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:34.377122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198c7fd541c549808b949d77fb74afc0)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:34.379150 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:34.506902 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198c7fd541c549808b949d77fb74afc0', 'request_id': 'req-60859d1d-ebe8-4831-9790-a09602b1d961'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:34.509061 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:34.513494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198c7fd541c549808b949d77fb74afc0', 'request_id': 'req-60859d1d-ebe8-4831-9790-a09602b1d961'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:34.520912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198c7fd541c549808b949d77fb74afc0', 'request_id': 'req-60859d1d-ebe8-4831-9790-a09602b1d961'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:34.668464 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] The token cache is being invalidate because project 198c7fd541c549808b949d77fb74afc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:44:34.674818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:34.674818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-60859d1d-ebe8-4831-9790-a09602b1d961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:34.674818 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1308/2632] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:44:34 2022] DELETE /identity/v3/projects/198c7fd541c549808b949d77fb74afc0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:34.683574 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:34.684113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:34.684113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:34.705246 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:34.706566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:34.790294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1325/2633] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:34.799735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:34.800487 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:34.800875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:34.829423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:34.830800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:34.841934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1309/2634] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:34.846449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:34.857379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63448e-9573-4e13-a387-956050efdc63 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:34.864736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:34.865512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:34.865878 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:34.866239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:34.867057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:44:34.867447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:34.870705 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:34.894961 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1326/2635] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:44:34.895149 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:34.910653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beada43-a260-436e-bdb7-5f9bc892c48d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:34.918491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:34.919686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:34.920195 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:34.920740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:34.925069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:34.926129 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.033476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1310/2636] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:44:34 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:35.037854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:35.045371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:35.048920 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a577d5-866c-4619-9269-c8cd431ff5ba admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:35.111424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:35.112102 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.112430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.112783 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.113390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:35.115400 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.226687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1327/2637] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:44:35 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:35.228606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:35.239132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff647-0a1c-4085-8015-8c0bf87dd6cb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:35.243794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:35.244499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.244790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.245073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.245835 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:35.247448 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.259069 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1311/2638] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:35.263154 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:35.274645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5a097-6667-47f4-a40b-c12d2f3bf76d admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:35.279304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be69d-a3f6-4ca4-9f2a-e8a9fb62192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:35.280005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be69d-a3f6-4ca4-9f2a-e8a9fb62192f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.280297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be69d-a3f6-4ca4-9f2a-e8a9fb62192f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.280618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be69d-a3f6-4ca4-9f2a-e8a9fb62192f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.281352 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59be69d-a3f6-4ca4-9f2a-e8a9fb62192f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:35.283594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59be69d-a3f6-4ca4-9f2a-e8a9fb62192f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.294122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1328/2639] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:35.298470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:35.308603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f00613-394a-49eb-8b86-6e8be3de1198 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:35.313717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:35.317165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.317165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.317165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] PATH_INFO: `/v3/projects/792734ac1699496cb7160727909f59f5/users/a39397698dc249bfb6a8b647eeaa8c1b/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.331530 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=792734ac1699496cb7160727909f59f5, user_id=a39397698dc249bfb6a8b647eeaa8c1b, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:35.334233 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.400850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1312/2640] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:44:35 2022] PUT /identity/v3/projects/792734ac1699496cb7160727909f59f5/users/a39397698dc249bfb6a8b647eeaa8c1b/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:35.412029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.412297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.412620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.441047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] MFA Rules not processed for user `a39397698dc249bfb6a8b647eeaa8c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:35.443289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:35.507453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1329/2641] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:35.519067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:35.521213 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:35.608166 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c719-0ee6-44e7-ae5f-f3817c2a0e1f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:35.614779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbad38c-c9f1-43c3-8f6f-9ed361d33d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:35.615446 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbad38c-c9f1-43c3-8f6f-9ed361d33d46 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.615725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbad38c-c9f1-43c3-8f6f-9ed361d33d46 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.616000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbad38c-c9f1-43c3-8f6f-9ed361d33d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.624717 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbad38c-c9f1-43c3-8f6f-9ed361d33d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:35.626304 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbad38c-c9f1-43c3-8f6f-9ed361d33d46 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.635719 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1313/2642] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:41.860384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:41.927098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414184f-b335-49c2-b887-fc411d2be938 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:41.932014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:41.932928 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:41.933207 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:41.933489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] PATH_INFO: `/v3/users/a39397698dc249bfb6a8b647eeaa8c1b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:41.934752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39397698dc249bfb6a8b647eeaa8c1b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:41.936745 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:41.959606 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:42.185152 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39397698dc249bfb6a8b647eeaa8c1b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:42.288239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39397698dc249bfb6a8b647eeaa8c1b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:42.289038 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39397698dc249bfb6a8b647eeaa8c1b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:42.289774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39397698dc249bfb6a8b647eeaa8c1b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:42.302470 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39397698dc249bfb6a8b647eeaa8c1b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:42.315423 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1330/2643] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:44:41 2022] DELETE /identity/v3/users/a39397698dc249bfb6a8b647eeaa8c1b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:42.320511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:42.321021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:42.321316 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:42.340002 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:42.341303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:42.401349 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1314/2644] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:42.411476 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:42.412988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:42.473303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6627d-f350-466a-ba94-adf6ae4028ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:42.476918 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7732e1-cc92-4539-bb1c-6883223bcee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:42.477579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7732e1-cc92-4539-bb1c-6883223bcee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:42.477866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7732e1-cc92-4539-bb1c-6883223bcee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:42.478149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7732e1-cc92-4539-bb1c-6883223bcee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:42.488304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7732e1-cc92-4539-bb1c-6883223bcee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:42.489866 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7732e1-cc92-4539-bb1c-6883223bcee2 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:42.501065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1331/2645] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:43.055644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:43.057220 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:43.064773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:43.070705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d12d56-f238-4cbe-9b2f-1080d5680774 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:43.076352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:43.077603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.078075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.078515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] PATH_INFO: `/v3/projects/792734ac1699496cb7160727909f59f5` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.080003 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792734ac1699496cb7160727909f59f5)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:43.082173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:43.263862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792734ac1699496cb7160727909f59f5', 'request_id': 'req-86e6c47f-1f74-4a04-80b6-e9bd576aa376'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:43.270545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792734ac1699496cb7160727909f59f5', 'request_id': 'req-86e6c47f-1f74-4a04-80b6-e9bd576aa376'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:43.278255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792734ac1699496cb7160727909f59f5', 'request_id': 'req-86e6c47f-1f74-4a04-80b6-e9bd576aa376'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:43.366242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] The token cache is being invalidate because project 792734ac1699496cb7160727909f59f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:44:43.367408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:43.367408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-86e6c47f-1f74-4a04-80b6-e9bd576aa376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:43.369382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1315/2646] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:44:43 2022] DELETE /identity/v3/projects/792734ac1699496cb7160727909f59f5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:43.374372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.375213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.375213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.397586 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:43.399096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:43.475516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1332/2647] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:43.483619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.484526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.484526 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.504976 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:43.506249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:43.515254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1316/2648] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:43.519851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:43.530037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e7e7c-0b26-44c5-a1f1-f36d008f90b3 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:43.534884 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:43.535562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.535851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.536309 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.537125 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:44:43.537437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:43.539181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:43.552723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1333/2649] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:44:43.557471 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:43.570993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba2e75-5c3d-4881-a343-73d43e1c2dcd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:43.576273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:43.576983 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.577265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.577565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.578313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:43.580282 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:43.679644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1317/2650] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:44:43 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:44:43.685197 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:43.700372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b33b4-a75e-4719-848e-4a9cf2815211 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:43.726539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:43.773851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:43.774862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.775151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.775431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.776145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:43.778228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:43.949331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1334/2651] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:44:43 2022] POST /identity/v3/users => generated 279 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:43.954183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:43.964936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8742-ace8-4bc4-b886-0e756e642707 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:43.970839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:43.971532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:43.971836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:43.972110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:43.972934 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:43.974639 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:43.986843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1318/2652] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:43.997166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.008011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00fcc3-2a93-492b-acfb-e2b1efda12d8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:44.012877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc2003-ee5a-4339-8597-4e3413a6d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:44.013543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc2003-ee5a-4339-8597-4e3413a6d951 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.013823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc2003-ee5a-4339-8597-4e3413a6d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.014101 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc2003-ee5a-4339-8597-4e3413a6d951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.014818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc2003-ee5a-4339-8597-4e3413a6d951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:44.016462 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc2003-ee5a-4339-8597-4e3413a6d951 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:44.029170 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1335/2653] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:44.034591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.045907 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad55524-51ff-4184-b8d8-29cb95991ef3 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:44.051488 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:44.052443 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.052729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.053010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] PATH_INFO: `/v3/projects/7ac71fa7b89b4a45bdc29dadc8d9613b/users/26d474b41c5c416fbac3804523b37a67/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.070871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac71fa7b89b4a45bdc29dadc8d9613b, user_id=26d474b41c5c416fbac3804523b37a67, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:44.077390 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:44.174461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1319/2654] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:44:44 2022] PUT /identity/v3/projects/7ac71fa7b89b4a45bdc29dadc8d9613b/users/26d474b41c5c416fbac3804523b37a67/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:44.189714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231016c3-d751-4997-aefc-06380f687d65 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.189714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231016c3-d751-4997-aefc-06380f687d65 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.189714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231016c3-d751-4997-aefc-06380f687d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.217681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-231016c3-d751-4997-aefc-06380f687d65 None None] MFA Rules not processed for user `26d474b41c5c416fbac3804523b37a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:44.218898 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-231016c3-d751-4997-aefc-06380f687d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:44.293509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1336/2655] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:44.295600 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.373658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05cd6-389c-4762-b74d-b76ca211700e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:44.379231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:44.380038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.380408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.380722 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.381508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:44.383550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:44.581401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1320/2656] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:44:44 2022] POST /identity/v3/projects => generated 357 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:44.585862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231016c3-d751-4997-aefc-06380f687d65 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.597564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231016c3-d751-4997-aefc-06380f687d65 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:44.662845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:44.663603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.663970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.664253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.665022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:44.667134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:44.769910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1337/2657] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:44:44 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:44.774511 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.787752 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d72e-088c-467c-8831-8756d8f86fa4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:44.792745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:44.793428 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.793713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.793998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.794725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:44.796371 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:44.799058 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:44.813441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1321/2658] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:44.819635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.831355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2170-705f-4a63-8196-a22dcb8882d7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:44.836809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:44.837834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:44.838189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:44.838535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] PATH_INFO: `/v3/projects/0ddb235d8652486fbb6ac5e1846717ec/users/97b83ffd73ad4c50bb2be4f73ccaa6ae/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:44.857518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddb235d8652486fbb6ac5e1846717ec, user_id=97b83ffd73ad4c50bb2be4f73ccaa6ae, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:44.861177 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:44.865763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:44.938512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1338/2659] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:44:44 2022] PUT /identity/v3/projects/0ddb235d8652486fbb6ac5e1846717ec/users/97b83ffd73ad4c50bb2be4f73ccaa6ae/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:44.942677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:44.956039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5782-5081-43e1-962e-01bf7160531c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:45.030243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1186de-d8a2-4273-ac42-ae2ee6e32c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:45.030243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1186de-d8a2-4273-ac42-ae2ee6e32c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:45.030243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1186de-d8a2-4273-ac42-ae2ee6e32c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:45.030243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1186de-d8a2-4273-ac42-ae2ee6e32c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:45.031252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1186de-d8a2-4273-ac42-ae2ee6e32c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:45.033308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1186de-d8a2-4273-ac42-ae2ee6e32c88 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:45.045843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1322/2660] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:45.050645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:45.062618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5feb6-5f75-47c3-a54c-515775a32b3b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:45.069982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:45.071379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:45.071845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:45.072180 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] PATH_INFO: `/v3/projects/0ddb235d8652486fbb6ac5e1846717ec/users/97b83ffd73ad4c50bb2be4f73ccaa6ae/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:45.074316 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddb235d8652486fbb6ac5e1846717ec, user_id=97b83ffd73ad4c50bb2be4f73ccaa6ae, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:45.077088 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:45.090921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1339/2661] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:44:45 2022] PUT /identity/v3/projects/0ddb235d8652486fbb6ac5e1846717ec/users/97b83ffd73ad4c50bb2be4f73ccaa6ae/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:45.101465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:45.101809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:45.102037 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:45.133235 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] MFA Rules not processed for user `97b83ffd73ad4c50bb2be4f73ccaa6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:45.134509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:45.278467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1323/2662] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:44:45 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:45.292209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:45.294007 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:45.366703 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962eff-6d92-4e94-80f1-0f4ba6b82a1a admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:45.371762 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:45.372730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:45.373227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:45.374238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:45.388921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:45.390861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:45.402477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1340/2663] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:45 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:45.630743 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:45.641008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d300-67b2-46a4-a15a-08ea3596fd05 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:45.645438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:45.646208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:45.646486 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:45.646708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:45.721225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:45.722693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:45.733126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1324/2664] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:45 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:50.256285 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:50.257795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:50.333250 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe353-0eec-4f64-82f4-d87d3502d943 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:50.338618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:50.339297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:50.339582 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:50.339864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:50.341827 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:50.355064 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:50.356615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17265b5-6c0d-4f03-a171-b2454e8f9de1 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:50.367128 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1341/2665] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:44:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:55.728513 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:00.362647 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:07.903685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:07.968374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa786327-63eb-4091-b9fc-d98a028123d1 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:07.974214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:07.975094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:07.975376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:07.975653 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] PATH_INFO: `/v3/users/26d474b41c5c416fbac3804523b37a67` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:07.976868 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d474b41c5c416fbac3804523b37a67)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:07.978792 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:08.261676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d474b41c5c416fbac3804523b37a67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:08.376986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d474b41c5c416fbac3804523b37a67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:08.377613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d474b41c5c416fbac3804523b37a67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:08.390415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d474b41c5c416fbac3804523b37a67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:08.391073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d474b41c5c416fbac3804523b37a67'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:08.404641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1325/2666] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:07 2022] DELETE /identity/v3/users/26d474b41c5c416fbac3804523b37a67 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:08.409696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:08.410195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:08.410312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:08.427806 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:08.429047 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:08.495842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1342/2667] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:08.509726 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:08.511256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:08.573942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171bb62-05f2-4a45-a51c-37d0403a7d84 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:08.577491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:08.578126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:08.578404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:08.578682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:08.588603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:08.590021 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:08.599781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1326/2668] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:09.065360 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:09.066805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:09.079672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867aee-9d7b-4bef-bb22-0b031d1baa5c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:09.084652 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:09.085532 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:09.085810 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:09.086084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] PATH_INFO: `/v3/projects/7ac71fa7b89b4a45bdc29dadc8d9613b` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:09.087740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac71fa7b89b4a45bdc29dadc8d9613b)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:09.089234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:09.247135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac71fa7b89b4a45bdc29dadc8d9613b', 'request_id': 'req-401edaa1-c596-4203-a51f-9a5ba2f35b7b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.344983 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac71fa7b89b4a45bdc29dadc8d9613b', 'request_id': 'req-401edaa1-c596-4203-a51f-9a5ba2f35b7b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.352635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac71fa7b89b4a45bdc29dadc8d9613b', 'request_id': 'req-401edaa1-c596-4203-a51f-9a5ba2f35b7b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.366520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] The token cache is being invalidate because project 7ac71fa7b89b4a45bdc29dadc8d9613b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:09.366814 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.367514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.369138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1343/2669] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:09 2022] DELETE /identity/v3/projects/7ac71fa7b89b4a45bdc29dadc8d9613b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:09.373292 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:09.383649 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187540c3-7ffa-4f63-8c0d-ba116f3cc2f9 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:09.402672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:09.442126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:09.443009 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:09.443290 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:09.443564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] PATH_INFO: `/v3/users/97b83ffd73ad4c50bb2be4f73ccaa6ae` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:09.444788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b83ffd73ad4c50bb2be4f73ccaa6ae)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:09.446714 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:09.753522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b83ffd73ad4c50bb2be4f73ccaa6ae'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.894212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b83ffd73ad4c50bb2be4f73ccaa6ae'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.895157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b83ffd73ad4c50bb2be4f73ccaa6ae'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.909141 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b83ffd73ad4c50bb2be4f73ccaa6ae'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.909878 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c1d1f6f0-3f8e-4c3a-9191-aa82dfc11a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b83ffd73ad4c50bb2be4f73ccaa6ae'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:09.922831 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1327/2670] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:09 2022] DELETE /identity/v3/users/97b83ffd73ad4c50bb2be4f73ccaa6ae => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:10.372637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:10.374223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:10.388506 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401edaa1-c596-4203-a51f-9a5ba2f35b7b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:10.446669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:10.447494 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:10.447776 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:10.448049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] PATH_INFO: `/v3/projects/0ddb235d8652486fbb6ac5e1846717ec` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:10.449259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddb235d8652486fbb6ac5e1846717ec)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:10.451259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:10.609566 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:10.628235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddb235d8652486fbb6ac5e1846717ec', 'request_id': 'req-14f51749-0124-424f-9d3b-d533e8255fc4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:10.751175 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddb235d8652486fbb6ac5e1846717ec', 'request_id': 'req-14f51749-0124-424f-9d3b-d533e8255fc4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:10.761740 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddb235d8652486fbb6ac5e1846717ec', 'request_id': 'req-14f51749-0124-424f-9d3b-d533e8255fc4'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:10.773223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] The token cache is being invalidate because project 0ddb235d8652486fbb6ac5e1846717ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:10.773674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:10.774361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-14f51749-0124-424f-9d3b-d533e8255fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:10.775919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1344/2671] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:10 2022] DELETE /identity/v3/projects/0ddb235d8652486fbb6ac5e1846717ec => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:10.780916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:10.781426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:10.781535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:10.800450 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:10.801707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:10.862274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1328/2672] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:45:10.870307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:10.870598 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:10.870882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:10.893298 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:10.894529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:10.906080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1345/2673] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:10.910516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:10.920595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152d99c-dbd9-4b29-90a2-0fe437fb6bea None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:10.926018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:10.926690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:10.927004 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:10.927279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:10.928020 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:45:10.928352 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:10.929988 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:10.942634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1329/2674] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:45:10.947158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:10.956672 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2462dbe-4139-4098-9f96-2647690c9c98 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:10.961453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:10.962127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:10.962410 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:10.962688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:10.963389 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:10.965335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:11.138991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1346/2675] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:10 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:45:11.145359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:11.158637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ffc0-baa2-4d0d-ae04-4bca38c39226 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:11.185944 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:11.218217 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:11.218909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:11.219197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:11.219478 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:11.220262 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:11.222733 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:11.360103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1330/2676] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:11 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:11.364621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:11.375317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6d79-6204-4881-8e89-3f2b18d06cb1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:11.380277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:11.380972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:11.381263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:11.381541 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:11.382268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:11.383881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:11.395565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1347/2677] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:11.399882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:11.410650 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e58ff6-327d-4cf6-95b3-e09a2e68091f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:11.415337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431fa45-48ce-45ea-a5b5-40ce9000720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:11.415993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431fa45-48ce-45ea-a5b5-40ce9000720c admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:11.416272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431fa45-48ce-45ea-a5b5-40ce9000720c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:11.416591 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431fa45-48ce-45ea-a5b5-40ce9000720c admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:11.417289 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431fa45-48ce-45ea-a5b5-40ce9000720c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:11.418927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431fa45-48ce-45ea-a5b5-40ce9000720c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:11.431214 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1331/2678] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:11.440830 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:11.451028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e96e-113a-4a33-982b-5e5206d54d88 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:11.456677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:11.457559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:11.457903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:11.458182 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] PATH_INFO: `/v3/projects/71bf2cc4d759422dbbed80cca5ae943d/users/eaa77d63cbf6481a95caa5d34310d541/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:11.473512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bf2cc4d759422dbbed80cca5ae943d, user_id=eaa77d63cbf6481a95caa5d34310d541, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:11.476345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:11.617491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1348/2679] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:11 2022] PUT /identity/v3/projects/71bf2cc4d759422dbbed80cca5ae943d/users/eaa77d63cbf6481a95caa5d34310d541/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:11.629006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:11.629291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:11.629566 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:11.656015 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] MFA Rules not processed for user `eaa77d63cbf6481a95caa5d34310d541`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:11.657162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:11.722253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1332/2680] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:45:11.726807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:11.791960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13db2e5-be1d-4400-b2f4-dae18ef3df70 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:11.796750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:11.797409 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:11.797690 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:11.797985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:11.799323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:11.801275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:11.933327 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1349/2681] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:11 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:11.937467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:11.949369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbec93-ee5b-4b44-81fc-d205d9d84687 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.011851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.012641 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.012935 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.013218 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.013929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.015909 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:12.112312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1333/2682] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:11 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:12.116513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:12.128000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfb4b7-f40a-4061-a1ff-fdc7c3acd4ff admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.133030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.134069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.134069 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.134317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.135054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.136724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:12.151021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1350/2683] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:12.155522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:12.167416 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aeeed-5cff-4153-9c2b-3dd65e8ce789 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.172308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.173285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.174143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.174430 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] PATH_INFO: `/v3/projects/c23cd73665894c8f99d564d5e52c53ff/users/1d96f530d85647a89cda4c2cf593098a/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.199661 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23cd73665894c8f99d564d5e52c53ff, user_id=1d96f530d85647a89cda4c2cf593098a, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.202324 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:12.371374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1334/2684] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:12 2022] PUT /identity/v3/projects/c23cd73665894c8f99d564d5e52c53ff/users/1d96f530d85647a89cda4c2cf593098a/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:12.375370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:12.385623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317c779-6b7c-4007-b44f-c642504568b2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.406008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:12.441779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b789cf-8314-46dc-a378-db3bb13ae214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.442488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b789cf-8314-46dc-a378-db3bb13ae214 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.442770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b789cf-8314-46dc-a378-db3bb13ae214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.443048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b789cf-8314-46dc-a378-db3bb13ae214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.443799 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b789cf-8314-46dc-a378-db3bb13ae214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.445430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b789cf-8314-46dc-a378-db3bb13ae214 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:12.455645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1351/2685] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:12.459874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:12.465735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:12.471864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc103ff-2264-49af-8ec4-50a89c888e22 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.476809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.477701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.477981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.478257 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] PATH_INFO: `/v3/projects/c23cd73665894c8f99d564d5e52c53ff/users/1d96f530d85647a89cda4c2cf593098a/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.480427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23cd73665894c8f99d564d5e52c53ff, user_id=1d96f530d85647a89cda4c2cf593098a, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.490697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:12.494542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1335/2686] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:12 2022] PUT /identity/v3/projects/c23cd73665894c8f99d564d5e52c53ff/users/1d96f530d85647a89cda4c2cf593098a/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:12.504750 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.505040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.505317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.532036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] MFA Rules not processed for user `1d96f530d85647a89cda4c2cf593098a`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:12.533805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:12.601382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1352/2687] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:12.612623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:12.622412 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:12.680834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add2f0-464b-4acd-a4c2-8b24b7fe9212 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.684583 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38654e3-b0e3-4899-a1e2-865062081e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.685244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38654e3-b0e3-4899-a1e2-865062081e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.685527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38654e3-b0e3-4899-a1e2-865062081e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.685810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38654e3-b0e3-4899-a1e2-865062081e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.695630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38654e3-b0e3-4899-a1e2-865062081e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.697101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38654e3-b0e3-4899-a1e2-865062081e0f service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:12.708452 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1336/2688] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:12.736702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:12.802727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac22e8-1823-4127-8ef8-5be5227d21cc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:12.807555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:12.808483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:12.808770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:12.809049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] PATH_INFO: `/v3/users/eaa77d63cbf6481a95caa5d34310d541` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:12.810263 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa77d63cbf6481a95caa5d34310d541)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:12.812238 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:13.091704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa77d63cbf6481a95caa5d34310d541'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:13.093657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:13.206016 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa77d63cbf6481a95caa5d34310d541'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:13.206631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa77d63cbf6481a95caa5d34310d541'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:13.207247 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa77d63cbf6481a95caa5d34310d541'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:13.220370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa77d63cbf6481a95caa5d34310d541'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:13.234186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1353/2689] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:12 2022] DELETE /identity/v3/users/eaa77d63cbf6481a95caa5d34310d541 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:13.240951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:13.241580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:13.241580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:13.260184 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:13.261463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:13.324240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1337/2690] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:13.334018 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:13.335523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:13.394105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e5f1-a912-4236-977d-b4d57081f3ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:13.397939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:13.398595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:13.399135 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:13.399771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:13.410065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:13.411513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:13.422143 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1354/2691] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:13.963596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:13.965128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:13.978119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a31ccc-bb57-41e9-85c5-79a564d072f7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:13.982798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:13.983671 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:13.983954 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:13.984226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] PATH_INFO: `/v3/projects/71bf2cc4d759422dbbed80cca5ae943d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:13.985475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bf2cc4d759422dbbed80cca5ae943d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:13.987955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:14.158721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bf2cc4d759422dbbed80cca5ae943d', 'request_id': 'req-97feee46-4938-4636-b875-c1a48a453423'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.166073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bf2cc4d759422dbbed80cca5ae943d', 'request_id': 'req-97feee46-4938-4636-b875-c1a48a453423'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.172682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bf2cc4d759422dbbed80cca5ae943d', 'request_id': 'req-97feee46-4938-4636-b875-c1a48a453423'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.268632 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] The token cache is being invalidate because project 71bf2cc4d759422dbbed80cca5ae943d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:14.269310 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.269631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.272115 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1338/2692] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:13 2022] DELETE /identity/v3/projects/71bf2cc4d759422dbbed80cca5ae943d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:14.277043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:14.289753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2461b15-3f06-4f92-a7a6-0fb5284b39df service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:14.355577 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:14.356516 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:14.356833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:14.357148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] PATH_INFO: `/v3/users/1d96f530d85647a89cda4c2cf593098a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:14.358681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d96f530d85647a89cda4c2cf593098a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:14.360802 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:14.637517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d96f530d85647a89cda4c2cf593098a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.759637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d96f530d85647a89cda4c2cf593098a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.765198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d96f530d85647a89cda4c2cf593098a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.765198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d96f530d85647a89cda4c2cf593098a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.774949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:14.776530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8ccf5576-05ef-425c-b296-5003068a1c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d96f530d85647a89cda4c2cf593098a'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:14.788500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1355/2693] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:14 2022] DELETE /identity/v3/users/1d96f530d85647a89cda4c2cf593098a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:15.444815 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:15.447132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:15.460187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feee46-4938-4636-b875-c1a48a453423 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:15.473809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:15.520461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:15.521375 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:15.521658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:15.522014 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] PATH_INFO: `/v3/projects/c23cd73665894c8f99d564d5e52c53ff` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:15.523299 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23cd73665894c8f99d564d5e52c53ff)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:15.525357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:15.697986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23cd73665894c8f99d564d5e52c53ff', 'request_id': 'req-41032bf4-81d3-4cdd-8a6e-743b79273fd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:15.703536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23cd73665894c8f99d564d5e52c53ff', 'request_id': 'req-41032bf4-81d3-4cdd-8a6e-743b79273fd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:15.710494 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23cd73665894c8f99d564d5e52c53ff', 'request_id': 'req-41032bf4-81d3-4cdd-8a6e-743b79273fd2'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:15.862685 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] The token cache is being invalidate because project c23cd73665894c8f99d564d5e52c53ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:15.862982 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:15.863701 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-41032bf4-81d3-4cdd-8a6e-743b79273fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:15.865365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1339/2694] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:15 2022] DELETE /identity/v3/projects/c23cd73665894c8f99d564d5e52c53ff => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:45:15.870382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:15.870877 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:15.870998 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:15.889553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:15.890795 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:15.958123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1356/2695] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:15.963286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:15.963666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:15.963984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:15.983198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:15.984455 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:15.992405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1340/2696] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:15.996822 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.006787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d36a7d-0041-4d8a-8970-5cc0d18189b6 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.011466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.012111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.012439 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.012702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.013448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:45:16.013752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.015349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.027687 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1357/2697] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:45:16.031950 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.041623 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b75a28-48c3-46f8-9289-b28c0f477c1f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.046382 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.047846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.047846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.047846 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.048598 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.050891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.222467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1341/2698] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:16 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:16.227271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.241427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d691e2-2376-4c2d-836d-a6ed06aad1a8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.329510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.330422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.330772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.331119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.331954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.334308 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.493621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1358/2699] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:16 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:45:16.508784 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.521393 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dc178-4d69-489b-8882-63689526e75e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.526809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.527793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.528108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.528559 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.529319 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.530951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.543211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1342/2700] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:45:16.547215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.559029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3367b-3117-47a3-b950-b18238d59d27 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.564788 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5903a-075a-4cd8-8a3d-a8f9ce0200ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.565491 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5903a-075a-4cd8-8a3d-a8f9ce0200ab admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.565774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5903a-075a-4cd8-8a3d-a8f9ce0200ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.566049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5903a-075a-4cd8-8a3d-a8f9ce0200ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.566793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5903a-075a-4cd8-8a3d-a8f9ce0200ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.568564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5903a-075a-4cd8-8a3d-a8f9ce0200ab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.580179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1359/2701] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:45:16.585055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.600596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857201a-dfba-4d57-b2ea-ba96d6d47884 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.608442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.609843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.610354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.611370 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] PATH_INFO: `/v3/projects/28fcc0e442684d1d8d4559f3a5e9385c/users/bed89640012740a391d71fbefc9e6d4d/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.637705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fcc0e442684d1d8d4559f3a5e9385c, user_id=bed89640012740a391d71fbefc9e6d4d, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.643477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.855770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1343/2702] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:16 2022] PUT /identity/v3/projects/28fcc0e442684d1d8d4559f3a5e9385c/users/bed89640012740a391d71fbefc9e6d4d/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:16.867262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.867553 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.867834 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.899930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] MFA Rules not processed for user `bed89640012740a391d71fbefc9e6d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:16.901213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:16.952561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:16.982252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1360/2703] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:16.987550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:17.043300 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:17.064630 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2f2b-e5e2-4350-bfc3-60b4a082147b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:17.069940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:17.070628 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.070915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.071191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.071893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:17.073893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:17.234189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1344/2704] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:16 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:17.242364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:17.250556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650b109-5e26-418e-a1c9-cf28d9ae68e9 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:17.344669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:17.345948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.346227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.346605 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.347406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:17.350176 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:17.479505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1361/2705] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:17 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:17.481167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:17.492974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90725-aa46-4d13-ba2c-eef86b4ca03a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:17.497713 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:17.498258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.498585 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.498862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.500287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:17.501234 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:17.523017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1345/2706] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:17.524693 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:17.535412 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d169393-7aa2-446b-9263-81fac6a55467 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:17.541019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:17.541533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.542548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.542931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] PATH_INFO: `/v3/projects/688c359faeba412790b519ea8b152fce/users/8f14c1df7138465ba3604de15a5a4e2c/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.580592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c359faeba412790b519ea8b152fce, user_id=8f14c1df7138465ba3604de15a5a4e2c, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:17.585638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:17.740772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1362/2707] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:17 2022] PUT /identity/v3/projects/688c359faeba412790b519ea8b152fce/users/8f14c1df7138465ba3604de15a5a4e2c/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:45:17.745437 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:17.755901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45b301-978c-4971-a9c7-8fbcbd683c5d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:17.834710 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049cb3e-885b-4527-aa83-a9c470f0db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:17.835558 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cb3e-885b-4527-aa83-a9c470f0db36 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.836068 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cb3e-885b-4527-aa83-a9c470f0db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.836472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cb3e-885b-4527-aa83-a9c470f0db36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.837426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049cb3e-885b-4527-aa83-a9c470f0db36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:17.839410 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049cb3e-885b-4527-aa83-a9c470f0db36 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:17.853689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1346/2708] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:45:17.858029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:17.870272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a813493-cb74-4eb2-a1df-533336426ad1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:17.877373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:17.878660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.879114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.879568 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] PATH_INFO: `/v3/projects/688c359faeba412790b519ea8b152fce/users/8f14c1df7138465ba3604de15a5a4e2c/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.882268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c359faeba412790b519ea8b152fce, user_id=8f14c1df7138465ba3604de15a5a4e2c, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:17.886166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:17.908484 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1363/2709] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:17 2022] PUT /identity/v3/projects/688c359faeba412790b519ea8b152fce/users/8f14c1df7138465ba3604de15a5a4e2c/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:45:17.911830 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:17.912196 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:17.912571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:17.944246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] MFA Rules not processed for user `8f14c1df7138465ba3604de15a5a4e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:17.945683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:18.038787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1347/2710] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:18.048095 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:18.051361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:18.142845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131944-c1bb-4fda-91ee-ff36896756f1 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:18.147349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf715f-664d-4480-bd15-933018c52751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:18.147763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf715f-664d-4480-bd15-933018c52751 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:18.148051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf715f-664d-4480-bd15-933018c52751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:18.148353 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf715f-664d-4480-bd15-933018c52751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:18.159965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf715f-664d-4480-bd15-933018c52751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:18.161517 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf715f-664d-4480-bd15-933018c52751 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:18.172346 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1364/2711] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:18.259215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:18.361443 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf223ad-66a5-477d-b023-a3c7a9e59259 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:18.366353 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:18.367408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:18.367687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:18.367961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] PATH_INFO: `/v3/users/bed89640012740a391d71fbefc9e6d4d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:18.369303 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed89640012740a391d71fbefc9e6d4d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:18.371298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:18.929973 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed89640012740a391d71fbefc9e6d4d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:18.951570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:19.208296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed89640012740a391d71fbefc9e6d4d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:19.208896 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed89640012740a391d71fbefc9e6d4d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:19.222357 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed89640012740a391d71fbefc9e6d4d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:19.223127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed89640012740a391d71fbefc9e6d4d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:19.237764 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1348/2712] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:18 2022] DELETE /identity/v3/users/bed89640012740a391d71fbefc9e6d4d => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:19.242879 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:19.243418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:19.243538 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:19.262579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:19.263853 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:19.303359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:19.333215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1365/2713] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:19.343675 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:19.345297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:19.410678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a80a0-cb87-4e30-a209-2ce9bea7ae92 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:19.414828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:19.415514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:19.415800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:19.416081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:19.427387 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:19.429081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:19.441067 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1349/2714] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:20.057009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:20.059444 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:20.072300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79b3b7-386e-4293-bdd0-80c6466a6970 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:20.077679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:20.078681 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:20.079072 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:20.080031 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] PATH_INFO: `/v3/projects/28fcc0e442684d1d8d4559f3a5e9385c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:20.082239 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28fcc0e442684d1d8d4559f3a5e9385c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:20.084380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:20.238956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fcc0e442684d1d8d4559f3a5e9385c', 'request_id': 'req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.365742 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fcc0e442684d1d8d4559f3a5e9385c', 'request_id': 'req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.374209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fcc0e442684d1d8d4559f3a5e9385c', 'request_id': 'req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.386330 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] The token cache is being invalidate because project 28fcc0e442684d1d8d4559f3a5e9385c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:20.386627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.387311 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.389281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1366/2715] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:20 2022] DELETE /identity/v3/projects/28fcc0e442684d1d8d4559f3a5e9385c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:20.393380 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:20.405175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4081-eb2d-4db2-9c44-80bd043a0fe0 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:20.476644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:20.477545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:20.477961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:20.478201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] PATH_INFO: `/v3/users/8f14c1df7138465ba3604de15a5a4e2c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:20.479435 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f14c1df7138465ba3604de15a5a4e2c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:20.481538 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:20.810678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f14c1df7138465ba3604de15a5a4e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.910857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f14c1df7138465ba3604de15a5a4e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.911686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f14c1df7138465ba3604de15a5a4e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.932332 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f14c1df7138465ba3604de15a5a4e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.933241 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-4e5cac56-8d1d-4320-ae1c-51b55b3603c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f14c1df7138465ba3604de15a5a4e2c'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:20.956000 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1350/2716] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:20 2022] DELETE /identity/v3/users/8f14c1df7138465ba3604de15a5a4e2c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:21.082760 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:21.519422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:21.521336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:21.551248 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e037-e51c-4bd0-84e8-d6aa6d4b3060 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:21.617313 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:21.618195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:21.618477 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:21.618757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] PATH_INFO: `/v3/projects/688c359faeba412790b519ea8b152fce` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:21.619964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688c359faeba412790b519ea8b152fce)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:21.621941 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:21.815344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688c359faeba412790b519ea8b152fce', 'request_id': 'req-eee07049-bac4-47d0-8b17-6ff94523f439'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:22.013886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688c359faeba412790b519ea8b152fce', 'request_id': 'req-eee07049-bac4-47d0-8b17-6ff94523f439'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:22.022035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688c359faeba412790b519ea8b152fce', 'request_id': 'req-eee07049-bac4-47d0-8b17-6ff94523f439'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:22.024349 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:22.053361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] The token cache is being invalidate because project 688c359faeba412790b519ea8b152fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:22.053361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:22.053361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-eee07049-bac4-47d0-8b17-6ff94523f439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:22.053361 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1367/2717] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:21 2022] DELETE /identity/v3/projects/688c359faeba412790b519ea8b152fce => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:22.054735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.054735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.054735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.062101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:22.063379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:22.134480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1351/2718] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:22.140669 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.140988 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.141230 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.162158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:22.163442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:22.171658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1368/2719] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:22.176463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:22.186965 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d77c-b702-45f2-aa2c-ca4f06317198 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:22.193035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:22.193740 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.194029 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.194368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.195285 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:45:22.195609 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:22.197284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:22.211655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1352/2720] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:45:22.217645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:22.228260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee270-3ce2-4c6b-806f-8f528e4f78e0 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:22.233402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:22.234044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.237109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.237109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.237109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:22.238105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:22.428811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1369/2721] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:22 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:45:22.435497 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:22.446862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14bd42-43e3-4ad0-85fc-4435eacb99fa admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:22.524548 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:22.525451 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.525839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.526247 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.527099 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:22.529686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:22.811853 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1353/2722] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:22 2022] POST /identity/v3/users => generated 292 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:22.816297 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:22.827166 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a924f-bc55-47c7-95a6-983817dfeaac admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:22.832004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:22.832906 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.833277 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.833658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.834475 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:22.836254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:22.850779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1370/2723] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:22.855525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:22.866918 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081dde1-fed3-43e6-94fb-9bec7c8861eb admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:22.871584 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257837-5d7d-4416-a98f-fb6f40b116ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:22.872273 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257837-5d7d-4416-a98f-fb6f40b116ba admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.872644 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257837-5d7d-4416-a98f-fb6f40b116ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.872969 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257837-5d7d-4416-a98f-fb6f40b116ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.873723 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257837-5d7d-4416-a98f-fb6f40b116ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:22.875384 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257837-5d7d-4416-a98f-fb6f40b116ba admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:22.887475 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1354/2724] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:22.898427 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:22.911251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28701-f0eb-4840-b73a-373162cb1353 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:22.920623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:22.920623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:22.920623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:22.920623 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] PATH_INFO: `/v3/projects/17063480f0744296b49cb5881fc5529a/users/6b700c87fa3a4d63acea63331ca29113/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:22.943301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17063480f0744296b49cb5881fc5529a, user_id=6b700c87fa3a4d63acea63331ca29113, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:22.946130 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:23.135144 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:23.204068 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1371/2725] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:22 2022] PUT /identity/v3/projects/17063480f0744296b49cb5881fc5529a/users/6b700c87fa3a4d63acea63331ca29113/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:45:23.218055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:23.218586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:23.219085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:23.262204 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] MFA Rules not processed for user `6b700c87fa3a4d63acea63331ca29113`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:23.264476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:23.342807 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1355/2726] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:45:23.355294 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:23.357117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:23.422908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad92d0-4832-46e2-aec1-5d7fd0541fa3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:23.427403 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dafef5-09d2-4fc1-96da-f6bf89b6534c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:23.428266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dafef5-09d2-4fc1-96da-f6bf89b6534c service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:23.440004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dafef5-09d2-4fc1-96da-f6bf89b6534c service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:23.440004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dafef5-09d2-4fc1-96da-f6bf89b6534c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:23.441075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dafef5-09d2-4fc1-96da-f6bf89b6534c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:23.441862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dafef5-09d2-4fc1-96da-f6bf89b6534c service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:23.452714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1372/2727] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:23.473570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:23.550551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f902d5-1e71-4d51-bdd3-023898f6d34f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:23.555687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:23.556666 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:23.556953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:23.557227 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] PATH_INFO: `/v3/users/6b700c87fa3a4d63acea63331ca29113` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:23.558681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b700c87fa3a4d63acea63331ca29113)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:23.560781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:24.119682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b700c87fa3a4d63acea63331ca29113'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:24.293970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b700c87fa3a4d63acea63331ca29113'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:24.294662 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b700c87fa3a4d63acea63331ca29113'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:24.318617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b700c87fa3a4d63acea63331ca29113'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:24.318617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b700c87fa3a4d63acea63331ca29113'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:24.326001 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1356/2728] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:23 2022] DELETE /identity/v3/users/6b700c87fa3a4d63acea63331ca29113 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:24.330611 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:24.331098 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:24.331220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:24.350114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:24.351343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:24.413467 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1373/2729] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:24.424867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:24.426361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:24.482108 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559677c-8b09-4cb4-864e-340604456689 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:24.486640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcbfa5-6cc2-4f64-ae77-2a18c31ac575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:24.487311 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcbfa5-6cc2-4f64-ae77-2a18c31ac575 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:24.487594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcbfa5-6cc2-4f64-ae77-2a18c31ac575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:24.487862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcbfa5-6cc2-4f64-ae77-2a18c31ac575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:24.497745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcbfa5-6cc2-4f64-ae77-2a18c31ac575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:24.499212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcbfa5-6cc2-4f64-ae77-2a18c31ac575 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:24.509534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1357/2730] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:24.511674 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:25.331746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:25.333620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:25.346030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671bf7b-2296-444e-9274-92bb9c733cdc None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:25.350963 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:25.351820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:25.352214 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:25.352725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] PATH_INFO: `/v3/projects/17063480f0744296b49cb5881fc5529a` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:25.353859 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17063480f0744296b49cb5881fc5529a)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:25.361416 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:25.633183 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:25.652074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17063480f0744296b49cb5881fc5529a', 'request_id': 'req-8b97d8a7-d281-4a83-b5fe-df08d62a3799'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:25.765523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17063480f0744296b49cb5881fc5529a', 'request_id': 'req-8b97d8a7-d281-4a83-b5fe-df08d62a3799'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:25.773411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17063480f0744296b49cb5881fc5529a', 'request_id': 'req-8b97d8a7-d281-4a83-b5fe-df08d62a3799'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:25.787607 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] The token cache is being invalidate because project 17063480f0744296b49cb5881fc5529a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:25.788048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:25.788833 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8b97d8a7-d281-4a83-b5fe-df08d62a3799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:25.794890 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1374/2731] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:25 2022] DELETE /identity/v3/projects/17063480f0744296b49cb5881fc5529a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:25.796200 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:25.796696 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:25.799117 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:25.818536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:25.820054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:25.893688 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1358/2732] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:25.902074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:25.902367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:25.902657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:25.923139 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:25.925118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:25.933886 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1375/2733] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:25.938480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:25.949219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4deb67-7a17-47ee-928f-ae15a47f5d89 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:25.954828 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:25.955500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:25.955786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:25.956077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:25.956855 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:45:25.957251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:25.959924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:25.973867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1359/2734] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:45:25.978422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:25.989014 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774585-ba27-471e-9e46-c34e621cd872 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:25.994093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:25.994845 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:25.995335 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:25.996006 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:25.996770 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:25.999169 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:26.124726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1376/2735] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:25 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:26.129086 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:26.139953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb3b3-45a9-4f27-b20b-581eef4e2d2a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:26.219479 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:26.221045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:26.221236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:26.231399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:26.231399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:26.231399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:26.433550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1360/2736] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:26 2022] POST /identity/v3/users => generated 287 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:26.437972 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:26.450848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6dcf-daa7-45a2-8710-c0655161235e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:26.457451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:26.458123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:26.458417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:26.459145 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:26.459424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:26.461223 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:26.473219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1377/2737] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:45:26.477491 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:26.490618 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda22c0-b407-45bd-b103-eb8121494bf1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:26.496087 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e84ee-f505-4647-bf3b-9e8b407bfb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:26.496544 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e84ee-f505-4647-bf3b-9e8b407bfb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:26.497006 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e84ee-f505-4647-bf3b-9e8b407bfb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:26.497286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e84ee-f505-4647-bf3b-9e8b407bfb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:26.498052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e84ee-f505-4647-bf3b-9e8b407bfb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:26.499802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e84ee-f505-4647-bf3b-9e8b407bfb31 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:26.510900 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1361/2738] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:26.515199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:26.527265 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817070cf-3a6e-4ae4-9abd-c524c1342dc4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:26.532164 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:26.533132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:26.535907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:26.535907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] PATH_INFO: `/v3/projects/13e8bb58bd834b1b81afbcc35d7f9699/users/ee5b760bcebe4672ab7f81af9c309088/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:26.549772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e8bb58bd834b1b81afbcc35d7f9699, user_id=ee5b760bcebe4672ab7f81af9c309088, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:26.552483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:26.675149 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1378/2739] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:26 2022] PUT /identity/v3/projects/13e8bb58bd834b1b81afbcc35d7f9699/users/ee5b760bcebe4672ab7f81af9c309088/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:26.686562 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:26.686776 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:26.687081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:26.693699 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:26.718405 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] MFA Rules not processed for user `ee5b760bcebe4672ab7f81af9c309088`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:26.719657 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:26.792314 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1362/2740] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:26.806081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:26.808602 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:26.897832 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21179-ee1c-4f15-a033-0fcbdfaa2dc2 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:26.902539 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5483cdc-58f4-4bf6-975e-1bf51ce87774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:26.903304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5483cdc-58f4-4bf6-975e-1bf51ce87774 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:26.903591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5483cdc-58f4-4bf6-975e-1bf51ce87774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:26.903868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5483cdc-58f4-4bf6-975e-1bf51ce87774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:26.913720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5483cdc-58f4-4bf6-975e-1bf51ce87774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:26.915203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5483cdc-58f4-4bf6-975e-1bf51ce87774 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:26.926319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1379/2741] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:45:26.948097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:27.015596 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a60bc-7fdb-430f-bcde-b10b6ffd36b1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:27.029249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:27.029249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:27.029249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:27.029249 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] PATH_INFO: `/v3/users/ee5b760bcebe4672ab7f81af9c309088` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:27.029624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5b760bcebe4672ab7f81af9c309088)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:27.031460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:27.425940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5b760bcebe4672ab7f81af9c309088'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:27.502205 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5b760bcebe4672ab7f81af9c309088'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:27.502829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5b760bcebe4672ab7f81af9c309088'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:27.518341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5b760bcebe4672ab7f81af9c309088'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:27.519048 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5b760bcebe4672ab7f81af9c309088'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:27.531581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1363/2742] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:45:26 2022] DELETE /identity/v3/users/ee5b760bcebe4672ab7f81af9c309088 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:27.536731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:27.537211 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:27.537331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:27.556005 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:27.557268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:27.604290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:27.616161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1380/2743] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:27.625943 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:27.627392 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:27.641274 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:27.689253 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543977-70a0-46e9-b754-2f8d69165c08 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:27.693458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0b2e8-b1ab-4a6f-8df4-21e02f75467d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:27.694121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0b2e8-b1ab-4a6f-8df4-21e02f75467d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:27.694411 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0b2e8-b1ab-4a6f-8df4-21e02f75467d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:27.694690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0b2e8-b1ab-4a6f-8df4-21e02f75467d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:27.705325 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0b2e8-b1ab-4a6f-8df4-21e02f75467d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:27.706773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0b2e8-b1ab-4a6f-8df4-21e02f75467d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:27.717362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1364/2744] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:28.168213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:28.170850 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:28.195447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364af0-2313-4201-b233-6ea2787e68ac None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:28.203714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:28.205615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:28.206114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:28.206585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] PATH_INFO: `/v3/projects/13e8bb58bd834b1b81afbcc35d7f9699` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:28.208310 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e8bb58bd834b1b81afbcc35d7f9699)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:28.210510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:28.403252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e8bb58bd834b1b81afbcc35d7f9699', 'request_id': 'req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:28.487979 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e8bb58bd834b1b81afbcc35d7f9699', 'request_id': 'req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:28.494729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e8bb58bd834b1b81afbcc35d7f9699', 'request_id': 'req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:28.505957 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] The token cache is being invalidate because project 13e8bb58bd834b1b81afbcc35d7f9699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:28.506268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:28.506894 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5d3b248c-547d-4fcb-91c6-bcfa5bd5053f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:28.508688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1381/2745] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:45:28 2022] DELETE /identity/v3/projects/13e8bb58bd834b1b81afbcc35d7f9699 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:28.513427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:28.513915 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:28.514032 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:28.532053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:28.533288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:28.593693 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1365/2746] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:28.605341 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:28.605847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:28.606080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:28.625549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:28.627235 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:28.635929 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1382/2747] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:28.640231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:28.652949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef11b5-718a-4f3e-9d8f-289e1e8c3d43 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:28.658402 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:28.659081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:28.659363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:28.659642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:28.660415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:45:28.660729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:28.662358 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:28.676187 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1366/2748] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:45:28.680801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:28.690536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbca47-b357-473e-a59e-71c3d691c800 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:28.695804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:28.696496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:28.696781 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:28.697160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:28.698039 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:28.700791 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:28.810382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1383/2749] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:45:28 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:28.814419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:28.826167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258006c6-6b89-41ff-b348-2fe67a18c96d admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:28.896970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:28.897210 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:28.897611 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:28.897836 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:28.898561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:28.900692 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:29.363219 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1367/2750] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:45:28 2022] POST /identity/v3/users => generated 282 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:45:29.367642 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:29.377818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934272e-2106-45bb-a2ed-f53a9de542ba admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:29.382514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:29.383179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:29.383515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:29.383798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:29.384555 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:29.386323 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:29.403079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1384/2751] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:29.408148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:29.419489 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb280c-00f3-4d0d-b48b-149d2406e014 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:29.423981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc50737-fea9-445f-a8a6-ccabfbbf6ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:29.424686 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc50737-fea9-445f-a8a6-ccabfbbf6ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:29.424974 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc50737-fea9-445f-a8a6-ccabfbbf6ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:29.425254 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc50737-fea9-445f-a8a6-ccabfbbf6ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:29.426132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc50737-fea9-445f-a8a6-ccabfbbf6ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:29.427957 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc50737-fea9-445f-a8a6-ccabfbbf6ee1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:29.442599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1368/2752] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:45:29.446819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:29.457612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17573-4192-4422-9d23-64a50972b534 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:29.462411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:29.463306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:29.463625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:29.463904 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] PATH_INFO: `/v3/projects/e45b8d04fe0c433eb7cad5bc648fd1e3/users/33f10dbb894a42498fcd2e4fc1980b7d/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:29.480512 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45b8d04fe0c433eb7cad5bc648fd1e3, user_id=33f10dbb894a42498fcd2e4fc1980b7d, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:29.483222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:29.706591 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1385/2753] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:45:29 2022] PUT /identity/v3/projects/e45b8d04fe0c433eb7cad5bc648fd1e3/users/33f10dbb894a42498fcd2e4fc1980b7d/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:29.717125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9cc57-312f-4491-8d66-8fc65e3e99cc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:29.717565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9cc57-312f-4491-8d66-8fc65e3e99cc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:29.717711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9cc57-312f-4491-8d66-8fc65e3e99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:29.748599 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-61e9cc57-312f-4491-8d66-8fc65e3e99cc None None] MFA Rules not processed for user `33f10dbb894a42498fcd2e4fc1980b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:29.761707 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-61e9cc57-312f-4491-8d66-8fc65e3e99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:29.762243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:29.821770 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1369/2754] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:29.838808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:29.840585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:29.902334 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a28348-3e3b-4e21-9c96-3a4ab458e66e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:29.906074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:29.906801 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:29.907086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:29.907367 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:29.917303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:29.918919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:29.929015 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1386/2755] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:32.650111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:32.650111 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:32.650981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:32.668346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] MFA Rules not processed for user `12c7dcba864c4f5ebb3ca8c428b1e9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:32.669589 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:32.731805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1370/2756] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:45:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:33.096789 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:33.100109 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:33.119646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:33.165763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1649-24da-4df1-8d0e-a58e27b6ab79 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:33.169713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:33.170371 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:33.170658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:33.170939 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:33.172854 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:33.184395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:33.186114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24d1b7-090c-4620-a978-80afc66840a9 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:33.194482 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1387/2757] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:45:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:42.723593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=48 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:44.143030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=19 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:05.749833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:05.817127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820100a4-6e66-4c8a-bade-e38dabfda520 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:05.822363 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:05.823727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:05.824016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:05.824860 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] PATH_INFO: `/v3/users/33f10dbb894a42498fcd2e4fc1980b7d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:05.826199 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f10dbb894a42498fcd2e4fc1980b7d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:05.828142 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:06.072802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f10dbb894a42498fcd2e4fc1980b7d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:06.190687 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f10dbb894a42498fcd2e4fc1980b7d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:06.191312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f10dbb894a42498fcd2e4fc1980b7d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:06.204143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f10dbb894a42498fcd2e4fc1980b7d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:06.204852 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f10dbb894a42498fcd2e4fc1980b7d'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:06.217484 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1371/2758] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:46:05 2022] DELETE /identity/v3/users/33f10dbb894a42498fcd2e4fc1980b7d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:46:06.222536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:06.223051 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:06.223158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:06.242008 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:06.243241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:06.303564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1388/2759] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:06.315359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:06.316877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:06.377857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29b00d-866b-42a5-aa29-69c9ad0c2b31 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:06.381667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f5b27-2d22-4d20-983a-74e5130a2320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:06.382462 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5b27-2d22-4d20-983a-74e5130a2320 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:06.382749 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5b27-2d22-4d20-983a-74e5130a2320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:06.383024 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5b27-2d22-4d20-983a-74e5130a2320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:06.397102 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f5b27-2d22-4d20-983a-74e5130a2320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:06.398388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f5b27-2d22-4d20-983a-74e5130a2320 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:06.408999 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1372/2760] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:06.884025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:06.885533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:06.900226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59b75c-ad80-4554-8aa4-d60db52d5278 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:06.906345 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:06.907262 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:06.908123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:06.908480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] PATH_INFO: `/v3/projects/e45b8d04fe0c433eb7cad5bc648fd1e3` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:06.909596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45b8d04fe0c433eb7cad5bc648fd1e3)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:06.911746 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:07.046638 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45b8d04fe0c433eb7cad5bc648fd1e3', 'request_id': 'req-2ef242f7-de8a-4506-9986-d0aafd4b3065'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:07.156161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45b8d04fe0c433eb7cad5bc648fd1e3', 'request_id': 'req-2ef242f7-de8a-4506-9986-d0aafd4b3065'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:07.163805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45b8d04fe0c433eb7cad5bc648fd1e3', 'request_id': 'req-2ef242f7-de8a-4506-9986-d0aafd4b3065'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:07.174667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] The token cache is being invalidate because project e45b8d04fe0c433eb7cad5bc648fd1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:46:07.174987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:07.175811 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:07.177520 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1389/2761] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:46:06 2022] DELETE /identity/v3/projects/e45b8d04fe0c433eb7cad5bc648fd1e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:46:16.404033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:17.171414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:39.007525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:39.010148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:39.010148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:39.025800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] MFA Rules not processed for user `12c7dcba864c4f5ebb3ca8c428b1e9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:39.027056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:39.081765 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1373/2762] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:49.074453 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=25 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:51.473203 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:51.474719 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:51.533434 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef242f7-de8a-4506-9986-d0aafd4b3065 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:51.537874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:51.538523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:51.538809 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:51.539089 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:51.541019 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:51.612189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:51.613677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:51.624921 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1390/2763] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:01.619794 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=54 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:33.972044 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:33.978060 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:34.034424 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc7148-7d0e-4f91-a5bb-e8089298478e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:34.038209 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:34.042922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:34.042922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:34.042922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:34.042922 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:34.055460 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:34.056928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:34.068795 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1374/2764] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:47:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:44.062926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=26 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:49.174909 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:49.176592 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:49.251841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c3d93-b4f7-4eb9-8cf1-624f84063a74 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:49.257120 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:49.257805 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:49.258090 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:49.258370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:49.260156 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:49.273122 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:49.274714 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:49.285649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1391/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:47:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:49.318481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:49.325040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:49.390610 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d965dbe-6079-45c9-bf6a-154531483deb service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:49.397399 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:49.402320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:49.402320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:49.402320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] PATH_INFO: `/v3/users/12c7dcba864c4f5ebb3ca8c428b1e9a7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:49.402320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c7dcba864c4f5ebb3ca8c428b1e9a7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:49.402320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:49.605252 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c7dcba864c4f5ebb3ca8c428b1e9a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:49.660768 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c7dcba864c4f5ebb3ca8c428b1e9a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:49.661337 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c7dcba864c4f5ebb3ca8c428b1e9a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:49.674560 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c7dcba864c4f5ebb3ca8c428b1e9a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:49.675211 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-aa9f7feb-5673-4c27-91c3-89a414a15b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c7dcba864c4f5ebb3ca8c428b1e9a7'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:49.688470 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1375/2766] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:47:49 2022] DELETE /identity/v3/users/12c7dcba864c4f5ebb3ca8c428b1e9a7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:49.933610 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:49.944870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6ea24-faf2-4e34-8229-908ba5da7e8d service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.009639 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.010651 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.010940 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.011222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] PATH_INFO: `/v3/projects/17ee4872b216425cbc6e3515dd1e26f1` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.012982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ee4872b216425cbc6e3515dd1e26f1)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.014913 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.128062 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ee4872b216425cbc6e3515dd1e26f1', 'request_id': 'req-9a78677a-5387-412a-8638-9c93cf1341ed'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:50.201202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ee4872b216425cbc6e3515dd1e26f1', 'request_id': 'req-9a78677a-5387-412a-8638-9c93cf1341ed'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:50.209709 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ee4872b216425cbc6e3515dd1e26f1', 'request_id': 'req-9a78677a-5387-412a-8638-9c93cf1341ed'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:50.221472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] The token cache is being invalidate because project 17ee4872b216425cbc6e3515dd1e26f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:47:50.221778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:50.222419 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-9a78677a-5387-412a-8638-9c93cf1341ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:50.224053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1392/2767] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:47:49 2022] DELETE /identity/v3/projects/17ee4872b216425cbc6e3515dd1e26f1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:50.231034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.231034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.231034 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.256676 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:50.258016 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:50.336520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1376/2768] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:50.350075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.350446 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.350735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.373567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:50.374823 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:50.383632 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1393/2769] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:50.388625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.400127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204972-7e49-42d1-8a9d-a591ce2a9564 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.405911 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.406595 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.406883 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.407164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.407901 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:47:50.408208 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.409869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.422203 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1377/2770] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:47:50.428800 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.438820 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e92afa-8767-4679-b6e4-a57c46006e42 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.443614 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.444267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.444588 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.444869 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.445603 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.447540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.458228 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:50.533225 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1394/2771] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:47:50 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:50.536287 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.546875 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf1545-dd20-4fcc-9230-8ad28dee5c10 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.550869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:50.604429 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.605059 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.605340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.605614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.606313 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.608368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.690260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1378/2772] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:47:50 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:50.694382 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.705202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d7c97-0238-45e0-97f6-a64d58c711aa admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.709804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.711025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.711025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.711025 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.711691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.713317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.723515 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1395/2773] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:50.727689 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.737841 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef999e-b404-49ed-8924-df610070a6d1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.742799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45c4c-f87d-41ee-9d8d-49b612931680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.743606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45c4c-f87d-41ee-9d8d-49b612931680 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.743893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45c4c-f87d-41ee-9d8d-49b612931680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.744171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45c4c-f87d-41ee-9d8d-49b612931680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.744942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e45c4c-f87d-41ee-9d8d-49b612931680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.747185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e45c4c-f87d-41ee-9d8d-49b612931680 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.757492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1379/2774] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:50.761674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.772522 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cd6a6-bb05-4677-b8d0-9c35272fc01b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.777111 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.778030 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.778312 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.778587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] PATH_INFO: `/v3/projects/2ff85f2cccd94e76831941a31daf7b7f/users/280366756ff04a6b879e41e17fc6d380/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.795732 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff85f2cccd94e76831941a31daf7b7f, user_id=280366756ff04a6b879e41e17fc6d380, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.798426 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:50.915220 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1396/2775] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:47:50 2022] PUT /identity/v3/projects/2ff85f2cccd94e76831941a31daf7b7f/users/280366756ff04a6b879e41e17fc6d380/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:50.925926 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.926221 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.926510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.953739 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] MFA Rules not processed for user `280366756ff04a6b879e41e17fc6d380`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:50.954874 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.021802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1380/2776] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:51.032923 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.034744 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.112792 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2932614-b208-4edc-904e-c9a2f5111fe4 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.118766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90167b1-7a9e-4df9-8d1b-a97a692e07b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.121883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90167b1-7a9e-4df9-8d1b-a97a692e07b8 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.121883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90167b1-7a9e-4df9-8d1b-a97a692e07b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.121883 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90167b1-7a9e-4df9-8d1b-a97a692e07b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.130807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90167b1-7a9e-4df9-8d1b-a97a692e07b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.132471 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90167b1-7a9e-4df9-8d1b-a97a692e07b8 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.145414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1397/2777] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:51.376746 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.438567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d687c22-ee46-4eff-ab86-e0b7bc55a6b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.443137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.444018 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.444297 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.444602 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] PATH_INFO: `/v3/users/280366756ff04a6b879e41e17fc6d380` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.445799 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280366756ff04a6b879e41e17fc6d380)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.447721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.464369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:51.686171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280366756ff04a6b879e41e17fc6d380'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.786529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280366756ff04a6b879e41e17fc6d380'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.787173 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280366756ff04a6b879e41e17fc6d380'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.800580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280366756ff04a6b879e41e17fc6d380'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.801242 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280366756ff04a6b879e41e17fc6d380'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.816065 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1381/2778] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:47:51 2022] DELETE /identity/v3/users/280366756ff04a6b879e41e17fc6d380 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:51.820660 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.821829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.821829 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.838557 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:51.839779 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.898234 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1398/2779] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:51.920532 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.921984 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.979137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9283430-6a8d-4078-abf0-c4c63d1a2932 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.983543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c723c9-61f8-4242-beaa-44ad5d93b81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.984244 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c723c9-61f8-4242-beaa-44ad5d93b81a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.984565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c723c9-61f8-4242-beaa-44ad5d93b81a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.984933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c723c9-61f8-4242-beaa-44ad5d93b81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.994700 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c723c9-61f8-4242-beaa-44ad5d93b81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.996761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c723c9-61f8-4242-beaa-44ad5d93b81a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:52.006415 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1382/2780] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:52.498548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:52.500126 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:52.513049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cabb1-ce69-4b6e-8011-6b7bb1d82d89 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:52.518132 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:52.519283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:52.519570 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:52.519849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] PATH_INFO: `/v3/projects/2ff85f2cccd94e76831941a31daf7b7f` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:52.521140 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff85f2cccd94e76831941a31daf7b7f)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:52.523757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:52.664199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:52.673861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff85f2cccd94e76831941a31daf7b7f', 'request_id': 'req-396200af-0c32-42b2-b023-aa686a86fdab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:52.754689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff85f2cccd94e76831941a31daf7b7f', 'request_id': 'req-396200af-0c32-42b2-b023-aa686a86fdab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:52.761650 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff85f2cccd94e76831941a31daf7b7f', 'request_id': 'req-396200af-0c32-42b2-b023-aa686a86fdab'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:52.773664 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] The token cache is being invalidate because project 2ff85f2cccd94e76831941a31daf7b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:47:52.773950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:52.774634 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-396200af-0c32-42b2-b023-aa686a86fdab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:52.776189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1399/2781] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:47:52 2022] DELETE /identity/v3/projects/2ff85f2cccd94e76831941a31daf7b7f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:52.781135 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:52.781622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:52.781738 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:52.799074 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:52.803019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:52.859164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1383/2782] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:52.868189 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:52.868727 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:52.868914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:52.888003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:52.889241 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:52.897456 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1400/2783] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:52.901712 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:52.911510 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a6224-7685-4020-bb6d-1df291f0635a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:52.916341 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:52.916972 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:52.917258 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:52.917542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:52.918361 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:47:52.918678 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:52.920309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:52.932083 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1384/2784] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:47:52.937162 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:52.946279 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a4e33-2011-4f5a-9640-e9623a6a9023 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:52.951624 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:52.952303 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:52.952622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:52.952931 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:52.953626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:52.955518 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.067964 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1401/2785] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:47:52 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:53.072266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.083036 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960309d6-8afc-4a96-8b28-9e210f868e04 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.104348 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:53.141128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.141802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.142090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.142369 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.143051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.145376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.228940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1385/2786] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:47:53 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:53.233621 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.244479 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7be9-93c7-4473-80c6-14584dbf6f76 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.250209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.260179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.260179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.260179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.260179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.260179 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.265048 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1402/2787] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:53.269368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.279469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce0927-d36f-41c4-a8b9-2008b56fd596 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.284119 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93f62d-d55c-4981-8389-81f9bc2b07e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.284822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f62d-d55c-4981-8389-81f9bc2b07e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.285103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f62d-d55c-4981-8389-81f9bc2b07e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.285379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f62d-d55c-4981-8389-81f9bc2b07e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.286096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93f62d-d55c-4981-8389-81f9bc2b07e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.287697 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93f62d-d55c-4981-8389-81f9bc2b07e4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.300078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1386/2788] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:53.304507 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.315640 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3a37-15a7-4148-9a7f-5d98e4daae12 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.321218 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.322118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.322402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.322679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] PATH_INFO: `/v3/projects/933aad77841f47ca938adfb3ee943448/users/d9cd5c01f3ab472cb228046b0903b33a/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.338414 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933aad77841f47ca938adfb3ee943448, user_id=d9cd5c01f3ab472cb228046b0903b33a, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.341201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.411551 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1403/2789] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:47:53 2022] PUT /identity/v3/projects/933aad77841f47ca938adfb3ee943448/users/d9cd5c01f3ab472cb228046b0903b33a/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:53.423668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.423949 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.424230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.453771 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] MFA Rules not processed for user `d9cd5c01f3ab472cb228046b0903b33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:53.454993 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:53.519516 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1387/2790] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:53.524003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.589429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f094-f2f1-4502-b685-097182f048b8 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.594953 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.595618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.595908 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.596191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.596915 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.598849 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.724808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1404/2791] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:47:53 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:53.728820 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.740186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0438-b614-4a02-8197-24c1b94d6624 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.799163 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.799964 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.800075 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.800276 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.801011 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.802986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.880480 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1388/2792] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:47:53 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:53.884627 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.895907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f0c5b-5eed-4dcd-aadf-d3dd0994a371 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.901784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.903092 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.903377 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.903654 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.904548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.906213 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.918017 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1405/2793] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:53.922121 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.932113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd0da-f845-4df2-a3f9-328182afc029 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.936773 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.937647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.937927 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.938201 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] PATH_INFO: `/v3/projects/beae332706ab4b0d9306a8de31db7333/users/aaccf178bdde4704aa289cd4056f6344/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.953539 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beae332706ab4b0d9306a8de31db7333, user_id=aaccf178bdde4704aa289cd4056f6344, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.956176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:54.036056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:54.041933 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1389/2794] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:47:53 2022] PUT /identity/v3/projects/beae332706ab4b0d9306a8de31db7333/users/aaccf178bdde4704aa289cd4056f6344/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:54.045955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:54.056276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89006-4c8d-45f1-a1ed-fbd7ecce773e admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:54.088295 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:54.112499 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca752-de6a-40ea-8f96-63ec9de0131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:54.113275 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca752-de6a-40ea-8f96-63ec9de0131a admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:54.113565 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca752-de6a-40ea-8f96-63ec9de0131a admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:54.113843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca752-de6a-40ea-8f96-63ec9de0131a admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:54.114563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca752-de6a-40ea-8f96-63ec9de0131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:54.116168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca752-de6a-40ea-8f96-63ec9de0131a admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:54.126151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1406/2795] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:54.130408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:54.141275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc29f2-24f5-43ca-95b6-7ca36ca1e564 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:54.146097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:54.146998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:54.147279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:54.147550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] PATH_INFO: `/v3/projects/beae332706ab4b0d9306a8de31db7333/users/aaccf178bdde4704aa289cd4056f6344/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:54.149500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] RBAC: Authorizing `identity:create_grant(project_id=beae332706ab4b0d9306a8de31db7333, user_id=aaccf178bdde4704aa289cd4056f6344, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:54.152128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:54.163647 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1390/2796] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:47:54 2022] PUT /identity/v3/projects/beae332706ab4b0d9306a8de31db7333/users/aaccf178bdde4704aa289cd4056f6344/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:54.174201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:54.174495 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:54.174780 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:54.202839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] MFA Rules not processed for user `aaccf178bdde4704aa289cd4056f6344`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:54.204137 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:54.276063 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1407/2797] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:47:54.287215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:54.288946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:54.345725 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3386a4-1a60-47d9-8fcf-cc8e77b2062f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:54.350408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:54.351172 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:54.351550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:54.351989 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:54.362505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:54.363951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:54.374185 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1391/2798] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:47:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:54.579429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:54.589376 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734898a-bdf4-4f31-a496-a872d6ec5b5f None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:54.592950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f9ada-acca-42dd-b44f-f43201fa5b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:54.593585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9ada-acca-42dd-b44f-f43201fa5b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:54.593872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9ada-acca-42dd-b44f-f43201fa5b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:54.594151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9ada-acca-42dd-b44f-f43201fa5b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:54.651559 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f9ada-acca-42dd-b44f-f43201fa5b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:54.652743 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f9ada-acca-42dd-b44f-f43201fa5b1b service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:54.661613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1408/2799] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:47:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:03.602958 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:03.692077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a37c76-eb73-415f-9760-8a6505af6962 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:03.696690 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:03.697574 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:03.697851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:03.698127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] PATH_INFO: `/v3/users/d9cd5c01f3ab472cb228046b0903b33a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:03.699374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9cd5c01f3ab472cb228046b0903b33a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:03.701359 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:03.995215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9cd5c01f3ab472cb228046b0903b33a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:04.128794 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9cd5c01f3ab472cb228046b0903b33a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:04.129426 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9cd5c01f3ab472cb228046b0903b33a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:04.138408 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:04.142884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9cd5c01f3ab472cb228046b0903b33a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:04.143586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9cd5c01f3ab472cb228046b0903b33a'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:04.156711 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1392/2800] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:48:03 2022] DELETE /identity/v3/users/d9cd5c01f3ab472cb228046b0903b33a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:04.161364 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:04.167819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:04.167819 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:04.210473 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:04.211682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:04.236396 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:04.271930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1409/2801] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:04.282423 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:04.283975 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:04.343125 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd535bd-61a7-444e-a4b7-abf4360fda0b admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:04.346937 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:04.347592 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:04.347885 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:04.348161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:04.358379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:04.359814 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:04.370056 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1393/2802] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:04.802267 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:04.803731 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:04.817855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ca4a-e87f-49c0-ad9c-f36c60fc50d8 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:04.822925 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:04.824738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:04.825033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:04.825317 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] PATH_INFO: `/v3/projects/933aad77841f47ca938adfb3ee943448` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:04.826601 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=933aad77841f47ca938adfb3ee943448)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:04.828626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:04.935903 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933aad77841f47ca938adfb3ee943448', 'request_id': 'req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.011084 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933aad77841f47ca938adfb3ee943448', 'request_id': 'req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.018010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933aad77841f47ca938adfb3ee943448', 'request_id': 'req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.029424 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] The token cache is being invalidate because project 933aad77841f47ca938adfb3ee943448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:48:05.029720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.030392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.031955 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1410/2803] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:48:04 2022] DELETE /identity/v3/projects/933aad77841f47ca938adfb3ee943448 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:05.036103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:05.046175 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c01f-7d92-412d-bef6-f33321cc589c service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:05.106790 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:05.107735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:05.108025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:05.108396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] PATH_INFO: `/v3/users/aaccf178bdde4704aa289cd4056f6344` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:05.109638 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaccf178bdde4704aa289cd4056f6344)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:05.111633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:05.321128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaccf178bdde4704aa289cd4056f6344'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.437376 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaccf178bdde4704aa289cd4056f6344'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.438008 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaccf178bdde4704aa289cd4056f6344'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.450802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaccf178bdde4704aa289cd4056f6344'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.451469 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-bff2d4fe-c3ca-4006-b47f-1b90f7cbd48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaccf178bdde4704aa289cd4056f6344'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:05.463840 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1394/2804] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:48:05 2022] DELETE /identity/v3/users/aaccf178bdde4704aa289cd4056f6344 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:05.899116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:05.900812 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:05.916584 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39dc9-6387-4499-81b8-bbb4fa7f8c3b admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:05.977837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:05.978209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:05.978496 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:05.978773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] PATH_INFO: `/v3/projects/beae332706ab4b0d9306a8de31db7333` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:05.979970 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beae332706ab4b0d9306a8de31db7333)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:05.982107 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.114243 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beae332706ab4b0d9306a8de31db7333', 'request_id': 'req-76745e5d-e0b5-41c7-b6f2-720bab1133b0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:06.117873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:06.208907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beae332706ab4b0d9306a8de31db7333', 'request_id': 'req-76745e5d-e0b5-41c7-b6f2-720bab1133b0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:06.216438 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beae332706ab4b0d9306a8de31db7333', 'request_id': 'req-76745e5d-e0b5-41c7-b6f2-720bab1133b0'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:06.227658 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] The token cache is being invalidate because project beae332706ab4b0d9306a8de31db7333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:48:06.227956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:06.228646 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-76745e5d-e0b5-41c7-b6f2-720bab1133b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:06.230331 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1411/2805] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:48:05 2022] DELETE /identity/v3/projects/beae332706ab4b0d9306a8de31db7333 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:06.235482 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.235864 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.236035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.242834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:06.265063 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:06.266277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:06.329164 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1395/2806] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:06.337510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.370960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.370960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.370960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:06.370960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:06.370960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1412/2807] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:06.374443 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:06.384191 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6673dd-8a8e-4b75-9f3a-c0fb9c4ec33a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:06.389787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:06.390476 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.390758 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.391064 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.391793 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:48:06.392101 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:06.394094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.406581 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1396/2808] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:48:06.410919 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:06.420615 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c57026-161e-43ec-adf3-3e07f059c9ed None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:06.425736 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:06.426401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.426685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.426965 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.427674 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:06.429644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.544365 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1413/2809] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:48:06 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:48:06.548986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:06.559763 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3bad3-de79-4061-b52d-ac7e82f720cf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:06.616533 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:06.617365 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.617673 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.617939 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.618668 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:06.620656 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.706226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1397/2810] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:48:06 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:48:06.710420 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:06.721055 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa90a-d2c7-404f-8e53-2760d2965c86 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:06.725808 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:06.726466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.726758 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.727037 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.727885 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:06.729529 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.740735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1414/2811] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:48:06.744843 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:06.755466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9ccbb-13dc-4c57-958c-6e85cdb9726f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:06.763593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c338846-07cd-4e4e-b06e-c3a70b6ab7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:06.764268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c338846-07cd-4e4e-b06e-c3a70b6ab7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.764580 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c338846-07cd-4e4e-b06e-c3a70b6ab7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.764857 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c338846-07cd-4e4e-b06e-c3a70b6ab7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.765588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c338846-07cd-4e4e-b06e-c3a70b6ab7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:06.767323 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c338846-07cd-4e4e-b06e-c3a70b6ab7f2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.778362 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1398/2812] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:48:06.782609 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:06.793131 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e70aa-7d7f-40ab-b9a7-6064fa5b0084 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:06.798635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:06.799486 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.799766 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.800040 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] PATH_INFO: `/v3/projects/763245e86fc0451eb8acdc5498d1dde9/users/7fdb2ea55ab3438493c45e7bf573603d/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.817186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763245e86fc0451eb8acdc5498d1dde9, user_id=7fdb2ea55ab3438493c45e7bf573603d, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:06.819855 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:06.908276 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1415/2813] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:48:06 2022] PUT /identity/v3/projects/763245e86fc0451eb8acdc5498d1dde9/users/7fdb2ea55ab3438493c45e7bf573603d/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:06.913929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cad0-785d-4bde-95f2-d15c2be73f51 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:06.914223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cad0-785d-4bde-95f2-d15c2be73f51 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:06.914508 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cad0-785d-4bde-95f2-d15c2be73f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:06.932893 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1244cad0-785d-4bde-95f2-d15c2be73f51 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:06.934797 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1244cad0-785d-4bde-95f2-d15c2be73f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:06.995122 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1399/2814] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:48:07.005930 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:07.007637 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:07.085754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d06fdb-6b8a-4990-a6ae-6e07212f9e46 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:07.089366 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:07.090011 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:07.090292 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:07.090567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:07.100042 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:07.101510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:07.111392 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1416/2815] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:08.572587 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:08.573168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:08.573168 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:08.579817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:08.600747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] MFA Rules not processed for user `7fdb2ea55ab3438493c45e7bf573603d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:08.601961 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:08.667373 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1400/2816] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:08.672536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:08.682302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2681-10a6-46fc-8aa6-acf5585c5d93 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:08.686899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:08.687550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:08.687836 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:08.688116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:08.688842 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:08.690777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:08.804536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1417/2817] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:48:08 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:48:08.808597 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:08.819667 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30d924-3248-46aa-8cd4-f1646cb6cb8f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:08.876118 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:08.876825 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:08.877110 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:08.877388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:08.878088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:08.880012 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:09.008856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1401/2818] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:48:08 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:48:09.013429 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:09.024029 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b4ea3-2f5b-4c0e-98ef-45d2a3062491 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:09.029304 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:09.029959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:09.030245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:09.030526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:09.031253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:09.033033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:09.044587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1418/2819] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:48:09.048727 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:09.058695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3daf-46b8-4fa3-8d70-7f43c0952c3c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:09.063550 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:09.064463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:09.064741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:09.065010 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] PATH_INFO: `/v3/projects/73dc08b495fa406685551636d6f3c1e7/users/dcd2cd28d08b4b5a8f741bf62e5b8772/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:09.080312 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dc08b495fa406685551636d6f3c1e7, user_id=dcd2cd28d08b4b5a8f741bf62e5b8772, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:09.082923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:09.223498 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1402/2820] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:48:09 2022] PUT /identity/v3/projects/73dc08b495fa406685551636d6f3c1e7/users/dcd2cd28d08b4b5a8f741bf62e5b8772/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:09.227625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:09.257093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f266-6e76-4109-8492-0d5552b5adb5 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:09.270874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:09.314708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884eb8-0803-4427-b675-81cdcffab25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:09.315395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884eb8-0803-4427-b675-81cdcffab25f admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:09.315682 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884eb8-0803-4427-b675-81cdcffab25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:09.315960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884eb8-0803-4427-b675-81cdcffab25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:09.316729 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884eb8-0803-4427-b675-81cdcffab25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:09.318359 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884eb8-0803-4427-b675-81cdcffab25f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:09.329119 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1419/2821] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:48:09.333427 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:09.353229 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410d9f9-1d13-45c6-9af7-9b9d1e08f20a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:09.358186 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b6f0a-e142-44ab-b22c-7849f3a44114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:09.359176 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6f0a-e142-44ab-b22c-7849f3a44114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:09.359461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6f0a-e142-44ab-b22c-7849f3a44114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:09.359741 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6f0a-e142-44ab-b22c-7849f3a44114 admin admin] PATH_INFO: `/v3/projects/73dc08b495fa406685551636d6f3c1e7/users/dcd2cd28d08b4b5a8f741bf62e5b8772/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:09.361761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b6f0a-e142-44ab-b22c-7849f3a44114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dc08b495fa406685551636d6f3c1e7, user_id=dcd2cd28d08b4b5a8f741bf62e5b8772, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:09.364520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b6f0a-e142-44ab-b22c-7849f3a44114 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:09.375237 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1403/2822] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:48:09 2022] PUT /identity/v3/projects/73dc08b495fa406685551636d6f3c1e7/users/dcd2cd28d08b4b5a8f741bf62e5b8772/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:10.795202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:10.795730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:10.800619 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:10.822595 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] MFA Rules not processed for user `dcd2cd28d08b4b5a8f741bf62e5b8772`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:10.823841 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:10.891116 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1420/2823] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:10.901582 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:10.902093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:10.902212 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:10.919419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] MFA Rules not processed for user `7fdb2ea55ab3438493c45e7bf573603d`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:10.920655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:10.953617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:10.978345 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1404/2824] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:48:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:10.991191 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:10.992683 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:11.065872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e595261-4651-41e8-b43d-80e8ed87c44e None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:11.071374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:11.072097 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:11.072415 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:11.072697 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:11.081148 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:11.082730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:11.091733 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1421/2825] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:19.452189 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:19.525735 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12743-c700-4b65-b251-8edc10fb558d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:19.529458 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:19.535230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:19.535230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:19.535230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:19.535230 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:19.555626 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:19.557106 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:19.566084 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1405/2826] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:20.475158 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:20.476926 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:20.499093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9d13-113b-4f6b-b8f2-78a2e3ef3c2c service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:20.504543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:20.505306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:20.505483 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:20.505765 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:20.507782 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:20.522254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:20.523959 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:20.537445 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1422/2827] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:26.213891 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:26.227658 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abed0b-371d-4e3c-90db-0868f5e1e9c3 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:26.233151 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:26.234240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:26.234240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:26.234492 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:26.236138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:26.249442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:26.251028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:26.262483 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1406/2828] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:30.533127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:31.500716 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:31.502260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:31.562564 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d801e-ef12-4a00-bc79-a58feafc65f6 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:31.567080 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:31.567735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:31.568024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:31.568307 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:31.577862 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:31.579370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:31.588956 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1423/2829] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:48:36.257088 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=49 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:41.584720 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=26 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:57.854822 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:57.856779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:57.941747 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5112f9-89ce-4358-a086-e6149efd7a2b service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:57.946869 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:57.947569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:57.947851 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:57.948138 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:57.950383 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:57.964941 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:57.966812 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:57.979336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1407/2830] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:58.015458 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:58.099949 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db00bf-b70b-44c3-b302-a943717a5b8d service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:58.107818 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:58.109370 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:58.109882 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:58.110960 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] PATH_INFO: `/v3/users/7fdb2ea55ab3438493c45e7bf573603d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:58.113151 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fdb2ea55ab3438493c45e7bf573603d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:58.117073 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:58.366718 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fdb2ea55ab3438493c45e7bf573603d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.461399 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fdb2ea55ab3438493c45e7bf573603d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.462096 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fdb2ea55ab3438493c45e7bf573603d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.462787 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fdb2ea55ab3438493c45e7bf573603d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.477848 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fdb2ea55ab3438493c45e7bf573603d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.490578 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1424/2831] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:48:58 2022] DELETE /identity/v3/users/7fdb2ea55ab3438493c45e7bf573603d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:58.759866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:58.774805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b224bfd-16be-4bd8-bfce-b8ebba265506 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:58.841378 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:58.842477 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:58.842786 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:58.843127 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] PATH_INFO: `/v3/projects/763245e86fc0451eb8acdc5498d1dde9` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:58.845145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] RBAC: Authorizing `identity:delete_project(project_id=763245e86fc0451eb8acdc5498d1dde9)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:58.847340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:58.972724 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763245e86fc0451eb8acdc5498d1dde9', 'request_id': 'req-f8b7de48-1568-4e62-9446-89bef9ddadad'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.978344 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763245e86fc0451eb8acdc5498d1dde9', 'request_id': 'req-f8b7de48-1568-4e62-9446-89bef9ddadad'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:58.984608 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763245e86fc0451eb8acdc5498d1dde9', 'request_id': 'req-f8b7de48-1568-4e62-9446-89bef9ddadad'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.131091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] The token cache is being invalidate because project 763245e86fc0451eb8acdc5498d1dde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:48:59.131525 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.132542 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.135161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1408/2832] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:48:58 2022] DELETE /identity/v3/projects/763245e86fc0451eb8acdc5498d1dde9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:48:59.139326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:59.146817 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:59.165290 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31e04-0413-4693-ae79-ee5f3533d6c0 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:59.258384 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:59.259283 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:59.259567 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:59.259843 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] PATH_INFO: `/v3/users/dcd2cd28d08b4b5a8f741bf62e5b8772` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:59.261103 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd2cd28d08b4b5a8f741bf62e5b8772)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:59.263035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:59.292405 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:59.591430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd2cd28d08b4b5a8f741bf62e5b8772'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.664864 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd2cd28d08b4b5a8f741bf62e5b8772'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.665618 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd2cd28d08b4b5a8f741bf62e5b8772'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.666369 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd2cd28d08b4b5a8f741bf62e5b8772'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.681460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-5857ff66-be6e-443f-90c6-e8b615fce027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd2cd28d08b4b5a8f741bf62e5b8772'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:48:59.695468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1425/2833] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:48:59 2022] DELETE /identity/v3/users/dcd2cd28d08b4b5a8f741bf62e5b8772 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:00.095660 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:00.097177 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:00.110240 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7de48-1568-4e62-9446-89bef9ddadad admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:00.129391 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:00.172669 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:00.174066 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.174347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.174625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] PATH_INFO: `/v3/projects/73dc08b495fa406685551636d6f3c1e7` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.175862 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dc08b495fa406685551636d6f3c1e7)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:00.177921 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:00.347847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dc08b495fa406685551636d6f3c1e7', 'request_id': 'req-687c767c-f66f-4210-afb6-1b89312fe6be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:00.354028 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dc08b495fa406685551636d6f3c1e7', 'request_id': 'req-687c767c-f66f-4210-afb6-1b89312fe6be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:00.360810 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dc08b495fa406685551636d6f3c1e7', 'request_id': 'req-687c767c-f66f-4210-afb6-1b89312fe6be'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:00.467260 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] The token cache is being invalidate because project 73dc08b495fa406685551636d6f3c1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:49:00.467552 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:00.468222 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-687c767c-f66f-4210-afb6-1b89312fe6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:00.470379 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1409/2834] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:49:00 2022] DELETE /identity/v3/projects/73dc08b495fa406685551636d6f3c1e7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:00.475480 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.476079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.476079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.517319 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:00.518847 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:00.585270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1426/2835] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:00.593243 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.593529 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.593806 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.613729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:00.614920 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:00.623500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1410/2836] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:00.627784 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:00.637685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebea59-192a-49da-a3ab-c56bc8ec5903 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:00.643269 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:00.643924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.644202 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.644513 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] PATH_INFO: `/v3/domains` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.645226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:49:00.645530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:00.647134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:00.659387 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1427/2837] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:49:00.663648 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:00.672859 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcace60-4833-440f-bfdd-7ac589870211 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:00.677439 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:00.678078 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.678463 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.678625 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.679837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:00.681236 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:00.766981 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1411/2838] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:00.771385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:00.783217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86e68-e763-43e1-bdf1-3295c8962300 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:00.849757 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:00.850457 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.850735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.851012 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.851730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:00.853872 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:00.947375 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:00.953735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1428/2839] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:49:00 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:00.958023 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:00.969081 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66208535-6e1c-4187-8401-aeecab7562f1 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:00.974347 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:00.975103 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:00.975395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:00.975677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:00.976520 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:00.978281 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:00.990096 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1412/2840] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:49:00.994306 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.005393 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50c63-fdf2-4a0d-969b-4a07cc1d39c3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.016580 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae235-1650-4a40-b9cf-9260bad2e00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.017333 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae235-1650-4a40-b9cf-9260bad2e00d admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.017950 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae235-1650-4a40-b9cf-9260bad2e00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.018142 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae235-1650-4a40-b9cf-9260bad2e00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.018873 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae235-1650-4a40-b9cf-9260bad2e00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.020536 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae235-1650-4a40-b9cf-9260bad2e00d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.032563 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1429/2841] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:01.036914 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.047395 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca335-c6e7-453f-bd14-757b832a6bd7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.052775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.054265 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.054551 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.054829 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] PATH_INFO: `/v3/projects/5cd5686371194f928685acf855250276/users/d24b7f97de7e4d84bbe90604e8270db8/roles/d132772f9a6144b996dae740722fe305` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.071761 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd5686371194f928685acf855250276, user_id=d24b7f97de7e4d84bbe90604e8270db8, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.074499 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.214132 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1413/2842] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:01 2022] PUT /identity/v3/projects/5cd5686371194f928685acf855250276/users/d24b7f97de7e4d84bbe90604e8270db8/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:01.226104 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.226489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.226772 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.254190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] MFA Rules not processed for user `d24b7f97de7e4d84bbe90604e8270db8`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:01.255422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:01.319091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1430/2843] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:49:01.323545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.371887 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:01.385948 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851cf5-e1d6-4ca3-bba5-1ebbede1deec admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.390801 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.391986 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.392271 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.392826 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.393536 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.395553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.509043 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1414/2844] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:49:01 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:01.513217 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.527678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637f892-abe7-44b1-88ab-a37903f85b56 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.586351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.587065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.587344 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.587622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.588340 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.590379 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.713645 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1431/2845] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:49:01 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:01.719315 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.737624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb54afb-3e71-4f30-bee0-b8a85553026a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.744919 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.745767 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.746052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.746331 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.747137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.748780 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.760951 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1415/2846] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:01.765432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.776636 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051a0cb-6230-47bd-a742-7a1fba990cc7 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.781644 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.782543 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.782826 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.783113 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] PATH_INFO: `/v3/projects/ac7b71cf73c040cf8257b0db72c48070/users/d0c2e24a95e645acbe04b09fb3a5abde/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.798622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7b71cf73c040cf8257b0db72c48070, user_id=d0c2e24a95e645acbe04b09fb3a5abde, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.801390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.907490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1432/2847] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:01 2022] PUT /identity/v3/projects/ac7b71cf73c040cf8257b0db72c48070/users/d0c2e24a95e645acbe04b09fb3a5abde/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:01.911534 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.921594 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee4e1-a9f6-4dd9-98cb-aae841d46694 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.981336 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945727-36f5-4d4f-afd6-12fa7e0bc942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.982013 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945727-36f5-4d4f-afd6-12fa7e0bc942 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.982298 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945727-36f5-4d4f-afd6-12fa7e0bc942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.982579 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945727-36f5-4d4f-afd6-12fa7e0bc942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.983321 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945727-36f5-4d4f-afd6-12fa7e0bc942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.984946 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945727-36f5-4d4f-afd6-12fa7e0bc942 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.995545 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1416/2848] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:02.000067 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:02.010947 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2901-3eb8-4e90-a414-c2c82c257319 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:02.015600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:02.016485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:02.016771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:02.017045 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] PATH_INFO: `/v3/projects/ac7b71cf73c040cf8257b0db72c48070/users/d0c2e24a95e645acbe04b09fb3a5abde/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:02.019245 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7b71cf73c040cf8257b0db72c48070, user_id=d0c2e24a95e645acbe04b09fb3a5abde, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:02.021910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:02.032901 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1433/2849] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:01 2022] PUT /identity/v3/projects/ac7b71cf73c040cf8257b0db72c48070/users/d0c2e24a95e645acbe04b09fb3a5abde/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:02.043250 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:02.043543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:02.043824 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:02.073147 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] MFA Rules not processed for user `d0c2e24a95e645acbe04b09fb3a5abde`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:02.074555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:02.143040 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1417/2850] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:49:02.153982 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:02.155661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:02.188991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:02.237186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50201c-6eba-4a25-acec-d29e1ed86513 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:02.240942 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2de6d-0a34-4d05-8070-90afc28b13a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:02.241587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2de6d-0a34-4d05-8070-90afc28b13a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:02.241905 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2de6d-0a34-4d05-8070-90afc28b13a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:02.242190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2de6d-0a34-4d05-8070-90afc28b13a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:02.299058 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2de6d-0a34-4d05-8070-90afc28b13a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:02.300544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2de6d-0a34-4d05-8070-90afc28b13a3 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:02.309594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1434/2851] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:05.652198 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:05.697564 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:05.715614 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502d39-ec56-4716-9907-d4523409ea53 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:05.720421 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:05.721291 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:05.721570 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:05.721842 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] PATH_INFO: `/v3/users/d24b7f97de7e4d84bbe90604e8270db8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:05.723089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24b7f97de7e4d84bbe90604e8270db8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:05.725053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:06.022293 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24b7f97de7e4d84bbe90604e8270db8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:06.104604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24b7f97de7e4d84bbe90604e8270db8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:06.105398 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24b7f97de7e4d84bbe90604e8270db8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:06.119280 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24b7f97de7e4d84bbe90604e8270db8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:06.120019 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24b7f97de7e4d84bbe90604e8270db8'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:06.132682 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1418/2852] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:49:05 2022] DELETE /identity/v3/users/d24b7f97de7e4d84bbe90604e8270db8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:06.137355 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:06.137846 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:06.142851 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:06.157318 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:06.158530 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:06.220118 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1435/2853] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:06.229967 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:06.231438 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:06.291924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad6ef1-da12-4e0f-b4f4-085b7f6a89ba admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:06.295604 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:06.296266 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:06.296603 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:06.296912 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:06.307737 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:06.309320 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:06.320052 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1419/2854] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:06.771863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:06.773314 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:06.789105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf83901-b66a-49be-a7dd-25c97c39274a None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:06.794552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:06.795442 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:06.795710 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:06.795994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] PATH_INFO: `/v3/projects/5cd5686371194f928685acf855250276` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:06.797587 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd5686371194f928685acf855250276)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:06.799527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:06.982244 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd5686371194f928685acf855250276', 'request_id': 'req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.130093 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd5686371194f928685acf855250276', 'request_id': 'req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.132659 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:07.137881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd5686371194f928685acf855250276', 'request_id': 'req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.150044 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] The token cache is being invalidate because project 5cd5686371194f928685acf855250276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:49:07.150417 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.151036 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.152678 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1436/2855] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:49:06 2022] DELETE /identity/v3/projects/5cd5686371194f928685acf855250276 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:07.157089 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:07.167388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405466f0-c563-4c1a-a992-c80785443d90 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:07.234097 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:07.234834 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:07.235637 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:07.235966 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] PATH_INFO: `/v3/users/d0c2e24a95e645acbe04b09fb3a5abde` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:07.237646 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c2e24a95e645acbe04b09fb3a5abde)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:07.240085 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:07.246889 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:07.529606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c2e24a95e645acbe04b09fb3a5abde'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.678515 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c2e24a95e645acbe04b09fb3a5abde'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.679216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c2e24a95e645acbe04b09fb3a5abde'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.692561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c2e24a95e645acbe04b09fb3a5abde'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.693255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-ace3422a-50f3-49ba-9283-bd118ba1cb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c2e24a95e645acbe04b09fb3a5abde'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:07.706522 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1420/2856] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:49:07 2022] DELETE /identity/v3/users/d0c2e24a95e645acbe04b09fb3a5abde => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:08.260688 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:08.262777 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:08.277271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2a00-f6c2-45a0-b019-f7b9e27ef57f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:08.342704 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:08.343552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:08.344026 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:08.345032 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] PATH_INFO: `/v3/projects/ac7b71cf73c040cf8257b0db72c48070` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:08.346500 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7b71cf73c040cf8257b0db72c48070)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:08.348815 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:08.483579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7b71cf73c040cf8257b0db72c48070', 'request_id': 'req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:08.641552 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7b71cf73c040cf8257b0db72c48070', 'request_id': 'req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:08.649022 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7b71cf73c040cf8257b0db72c48070', 'request_id': 'req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:08.661010 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] The token cache is being invalidate because project ac7b71cf73c040cf8257b0db72c48070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:49:08.661337 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:08.661910 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-054bc166-e5a7-4f0b-a51c-9b1f58f8b4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:08.663468 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1437/2857] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:49:08 2022] DELETE /identity/v3/projects/ac7b71cf73c040cf8257b0db72c48070 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:08.668472 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:08.669033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:08.669033 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:08.688354 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:08.689588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:08.760268 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1421/2858] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:08.770091 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:08.770385 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:08.770670 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:08.790548 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:08.791922 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:08.800503 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1438/2859] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:08.809350 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:08.819527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a366c1-8977-48c0-a002-6ae760dcb1ba None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:08.824620 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:08.825305 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:08.825593 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:08.825871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:08.826613 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:49:08.826924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:08.828588 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:08.842535 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1422/2860] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:49:08.848028 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:08.858585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c62a7-84ff-40e9-8210-9af28dd4d822 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:08.863691 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:08.864411 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:08.864702 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:08.864985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:08.865694 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:08.867661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:08.972254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1439/2861] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:49:08 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:49:08.976401 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:08.986803 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441694f7-aeef-4a9e-bc5b-3c4122c2d2cf admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:09.045255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:09.045936 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:09.046215 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:09.046514 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:09.047197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:09.049197 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:09.145963 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:09.151152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1423/2862] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:49:08 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:09.155351 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:09.166525 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d469-9d7f-4a8a-9a40-f5c6442778e3 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:09.171270 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:09.171932 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:09.172215 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:09.172521 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:09.173251 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:09.174899 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:09.186485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1440/2863] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:09.191158 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:09.201708 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16702aa8-f56b-4247-89ad-8646431bb28c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:09.211839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2798b-f8af-4e7f-840a-a904d7b6a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:09.211839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2798b-f8af-4e7f-840a-a904d7b6a1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:09.211839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2798b-f8af-4e7f-840a-a904d7b6a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:09.211839 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2798b-f8af-4e7f-840a-a904d7b6a1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:09.212279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2798b-f8af-4e7f-840a-a904d7b6a1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:09.212279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2798b-f8af-4e7f-840a-a904d7b6a1ba admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:09.221555 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1424/2864] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:09.225924 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:09.236684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a6216-e076-40fb-8c9a-ac0ab62d4ff9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:09.241594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:09.242478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:09.242756 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:09.243033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] PATH_INFO: `/v3/projects/8b402663e2ee4f57aa851548bf98224c/users/c629e039f5a6442eb0ccf8397f54bc59/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:09.258401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b402663e2ee4f57aa851548bf98224c, user_id=c629e039f5a6442eb0ccf8397f54bc59, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:09.261106 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:09.394622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1441/2865] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:09 2022] PUT /identity/v3/projects/8b402663e2ee4f57aa851548bf98224c/users/c629e039f5a6442eb0ccf8397f54bc59/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:09.461523 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061f914-db14-4d3c-ade1-5c350c62af8f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:09.461850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061f914-db14-4d3c-ade1-5c350c62af8f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:09.462077 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061f914-db14-4d3c-ade1-5c350c62af8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:09.496157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8061f914-db14-4d3c-ade1-5c350c62af8f None None] MFA Rules not processed for user `c629e039f5a6442eb0ccf8397f54bc59`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:09.497432 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8061f914-db14-4d3c-ade1-5c350c62af8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:09.570148 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1425/2866] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:09.580706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:09.582488 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:09.597049 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:09.641440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac84e7-f8d6-4f11-9560-55d3f88d4609 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:09.646186 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1b0792dd6a41ba82c5d04a08596bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:09.646839 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:09.647127 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:09.647406 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:09.655974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:09.663622 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:09.666684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1442/2867] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:11.615223 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd37bd-f42a-4e26-a29a-063d04bdec2a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:11.615775 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd37bd-f42a-4e26-a29a-063d04bdec2a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:11.615876 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd37bd-f42a-4e26-a29a-063d04bdec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:11.633615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-05cd37bd-f42a-4e26-a29a-063d04bdec2a None None] MFA Rules not processed for user `c629e039f5a6442eb0ccf8397f54bc59`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:11.634847 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-05cd37bd-f42a-4e26-a29a-063d04bdec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:11.642866 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1426/2868] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:14.576027 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:14.577485 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:14.648596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee70c1-4751-4396-81fe-45b6b7420471 service cinder] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:14.653844 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:14.654510 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:14.654793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:14.655074 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:14.656914 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:14.669821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:14.671450 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:14.683449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1443/2869] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:21.628017 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=40 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:24.677821 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=52 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:34.894924 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd05406-3188-4e9e-bc00-e359b91ae21d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:34.895396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd05406-3188-4e9e-bc00-e359b91ae21d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:34.895507 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd05406-3188-4e9e-bc00-e359b91ae21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:34.956275 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ccd05406-3188-4e9e-bc00-e359b91ae21d None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:34.957519 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ccd05406-3188-4e9e-bc00-e359b91ae21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:35.034721 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1427/2870] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:49:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:35.236698 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:35.238181 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:35.348544 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec156-59ff-4d35-8262-7d1522952449 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:35.353985 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:35.354657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:35.354945 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:35.355226 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:35.365301 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:35.366936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:35.376227 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1444/2871] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:49:36.393601 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a648a-78d9-492f-ac4c-0452701f94f6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:36.394171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a648a-78d9-492f-ac4c-0452701f94f6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:36.394622 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a648a-78d9-492f-ac4c-0452701f94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:36.420231 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-df2a648a-78d9-492f-ac4c-0452701f94f6 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:36.421619 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-df2a648a-78d9-492f-ac4c-0452701f94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:36.433356 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1428/2872] 10.222.0.67 () {58 vars in 967 bytes} [Fri May 27 09:49:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:36.442343 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:36.455065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4662-2c6c-43d4-b707-379e0cf5e3f3 service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:36.460778 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:36.461472 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:36.461773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:36.462053 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:36.471585 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:36.473254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:36.485086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1445/2873] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:49:37.273072 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fed70f-8170-4267-b5bc-b9662e21acc3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:37.273546 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fed70f-8170-4267-b5bc-b9662e21acc3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:37.273837 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fed70f-8170-4267-b5bc-b9662e21acc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:37.293128 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-95fed70f-8170-4267-b5bc-b9662e21acc3 None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:37.294364 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-95fed70f-8170-4267-b5bc-b9662e21acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:37.302804 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1429/2874] 10.222.0.67 () {58 vars in 1009 bytes} [Fri May 27 09:49:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:37.318661 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:37.334881 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4ff2-2360-4851-a527-3b128963421c service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:37.340240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:37.340954 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:37.341236 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:37.341508 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:37.352999 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:37.354708 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:37.365021 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1446/2875] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:49:38.120481 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:38.121025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:38.121025 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:38.141039 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] MFA Rules not processed for user `28369b07e3cf45fa90ca15d52c45e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:38.142567 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:38.150272 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1430/2876] 10.222.0.67 () {58 vars in 967 bytes} [Fri May 27 09:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:38.164509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:38.176083 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0350a-d7a9-41f5-937d-2b132932332b service swift] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:38.181430 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e8f8-576f-4a2c-ab18-be29cbee5fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8dcad979224353841afc735e1e7b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:38.182086 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e8f8-576f-4a2c-ab18-be29cbee5fec service swift] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:38.182372 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e8f8-576f-4a2c-ab18-be29cbee5fec service swift] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:38.182649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e8f8-576f-4a2c-ab18-be29cbee5fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:38.196129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e8f8-576f-4a2c-ab18-be29cbee5fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:38.197807 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e8f8-576f-4a2c-ab18-be29cbee5fec service swift] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:38.207738 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1447/2877] 10.222.0.67 () {60 vars in 1384 bytes} [Fri May 27 09:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:49:41.316787 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:41.390091 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad4d8-7aa3-45c5-83fc-a301bb2d71dd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:41.395073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:41.396035 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:41.396343 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:41.396635 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] PATH_INFO: `/v3/users/c629e039f5a6442eb0ccf8397f54bc59` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:41.398459 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c629e039f5a6442eb0ccf8397f54bc59)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:41.399905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:41.622800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:41.629500 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c629e039f5a6442eb0ccf8397f54bc59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:41.743634 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c629e039f5a6442eb0ccf8397f54bc59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:41.744279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c629e039f5a6442eb0ccf8397f54bc59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:41.758750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c629e039f5a6442eb0ccf8397f54bc59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:41.759651 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c629e039f5a6442eb0ccf8397f54bc59'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:41.775207 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1431/2878] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:49:41 2022] DELETE /identity/v3/users/c629e039f5a6442eb0ccf8397f54bc59 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:41.780300 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:41.781617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:41.781617 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:41.799730 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:41.809689 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:41.868388 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1448/2879] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:41.881895 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:41.883360 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:41.964145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd56442-1887-436c-a7c0-721f2daf8036 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:41.968152 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3413-888f-4c98-b20e-c19fffb7bb0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:41.968871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3413-888f-4c98-b20e-c19fffb7bb0b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:41.969162 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3413-888f-4c98-b20e-c19fffb7bb0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:41.969441 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3413-888f-4c98-b20e-c19fffb7bb0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:41.980442 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3413-888f-4c98-b20e-c19fffb7bb0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:41.981923 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3413-888f-4c98-b20e-c19fffb7bb0b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:41.994095 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1432/2880] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:42.324657 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:42.326594 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:42.347573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512ba4-0cde-4e13-ae45-4cdbf67c598c None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:42.353133 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:42.354124 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:42.354432 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:42.354713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] PATH_INFO: `/v3/projects/8b402663e2ee4f57aa851548bf98224c` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:42.356193 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b402663e2ee4f57aa851548bf98224c)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:42.358390 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:42.496368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:42.519268 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b402663e2ee4f57aa851548bf98224c', 'request_id': 'req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:42.614977 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b402663e2ee4f57aa851548bf98224c', 'request_id': 'req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:42.622987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b402663e2ee4f57aa851548bf98224c', 'request_id': 'req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:42.635897 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] The token cache is being invalidate because project 8b402663e2ee4f57aa851548bf98224c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:49:42.636281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:42.637009 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-4acbca0b-5d8f-4d6e-8032-3da4fc6b6f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:42.638625 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1449/2881] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:49:42 2022] DELETE /identity/v3/projects/8b402663e2ee4f57aa851548bf98224c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:42.647112 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:42.647953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:42.649126 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:42.679906 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:42.682165 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:42.756145 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1433/2882] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:42.763160 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:42.763451 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:42.763737 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:42.785075 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.auth.core [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:42.786326 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:42.794684 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1450/2883] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:49:42.801071 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:42.812621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a069693-ce9b-4778-ac9b-6c2d736790a3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:42.817572 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:42.818294 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:42.818576 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:42.818850 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:42.819606 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:49:42.819916 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:42.821654 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:42.835877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1434/2884] 10.222.0.67 () {58 vars in 1152 bytes} [Fri May 27 09:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:49:42.840380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:42.851185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad95bf0-fd17-4481-9fad-7c57c275ff44 None None] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:42.856222 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:42.856987 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:42.857272 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:42.857550 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:42.858266 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:42.860447 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:42.961201 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1451/2885] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:49:42 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:42.962571 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:42.973925 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc3e25-4240-4539-b2d3-35819152cf3f admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:43.028055 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:43.041695 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:43.043942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:43.043942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:43.043942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:43.043942 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:43.045553 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:43.130377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1435/2886] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:49:42 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:49:43.135459 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:43.147656 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4317d9-049a-45de-94ee-630b2cbf907f admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:43.152754 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:43.153435 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:43.153735 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:43.154000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:43.154752 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:43.156527 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:43.167667 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1452/2887] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:43.172928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:43.183913 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630f5fc-c501-442a-8ddf-590d5fc5df4c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:43.189377 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c6b0-0c4a-493a-8acb-487708748ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:43.190053 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c6b0-0c4a-493a-8acb-487708748ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:43.190335 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c6b0-0c4a-493a-8acb-487708748ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:43.190612 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c6b0-0c4a-493a-8acb-487708748ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:43.191346 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c6b0-0c4a-493a-8acb-487708748ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:43.193045 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c6b0-0c4a-493a-8acb-487708748ea8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:43.205524 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1436/2888] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:43.210004 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:43.220505 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185823d6-4ee1-440c-a6ee-75bfc2af84ee admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:43.225643 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:43.226562 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:43.226991 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:43.227413 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] PATH_INFO: `/v3/projects/6e547fa4865147df9c4074f38d310e32/users/b5a4d71e0ae443f887659a69b0fba447/roles/d132772f9a6144b996dae740722fe305` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:43.245281 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e547fa4865147df9c4074f38d310e32, user_id=b5a4d71e0ae443f887659a69b0fba447, role_id=d132772f9a6144b996dae740722fe305)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:43.248057 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:43.346514 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1453/2889] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:43 2022] PUT /identity/v3/projects/6e547fa4865147df9c4074f38d310e32/users/b5a4d71e0ae443f887659a69b0fba447/roles/d132772f9a6144b996dae740722fe305 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:43.351663 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73476-4179-4121-b4d8-42baeaa0cedc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:43.351962 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73476-4179-4121-b4d8-42baeaa0cedc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:43.352404 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73476-4179-4121-b4d8-42baeaa0cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:43.371113 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-18f73476-4179-4121-b4d8-42baeaa0cedc None None] MFA Rules not processed for user `fc703507b8b64f64800e473a23bfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:43.372501 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-18f73476-4179-4121-b4d8-42baeaa0cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:43.435467 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1437/2890] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:43.446198 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:43.447994 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:43.512524 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a2540-cda0-4b95-8936-327137760266 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:43.516401 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:43.517348 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:43.517631 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:43.517907 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:43.528073 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:43.529626 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:43.540519 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1454/2891] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:49:49.769226 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:49.769781 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:49.769928 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:49.805388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] MFA Rules not processed for user `b5a4d71e0ae443f887659a69b0fba447`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:49.806633 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:49.891884 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1438/2892] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:49.894259 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:49.904798 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56d3e-6814-4c7a-b3ae-375894ee7d56 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:49.910478 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:49.911240 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] REQUEST_METHOD: `POST` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:49.911526 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:49.911804 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] PATH_INFO: `/v3/projects` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:49.912556 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:49.914838 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:50.097422 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1455/2893] 10.222.0.67 () {60 vars in 1152 bytes} [Fri May 27 09:49:49 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:50.101882 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:50.113672 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f281d5-6650-4f6f-b6e4-2bd301211724 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:50.170817 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:50.177809 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:50.178527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:50.178813 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:50.179094 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:50.179798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:50.181779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:50.403406 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1439/2894] 10.222.0.67 () {60 vars in 1143 bytes} [Fri May 27 09:49:50 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:50.407613 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:50.418863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe6a4-0128-45d6-8b21-e4e1e9305970 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:50.424199 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:50.425000 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:50.425289 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:50.425707 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:50.426453 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:50.428070 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:50.441583 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1456/2895] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:50.451296 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:50.463730 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99256-82fd-4d88-8a4c-de09c60c43f8 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:50.468905 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:50.469856 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:50.470140 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:50.470419 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] PATH_INFO: `/v3/projects/a28a81101e044162940290f549349f4d/users/5c002f1227ca4d16986ce876f85e2e84/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:50.490339 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28a81101e044162940290f549349f4d, user_id=5c002f1227ca4d16986ce876f85e2e84, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:50.493681 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:50.693987 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1440/2896] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:50 2022] PUT /identity/v3/projects/a28a81101e044162940290f549349f4d/users/5c002f1227ca4d16986ce876f85e2e84/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:50.698676 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:50.711271 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0f03-fdca-457d-94ab-b50f760c5bb9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:50.731221 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:50.774487 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:50.775161 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:50.775443 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:50.775713 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:50.776466 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:50.778079 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:50.788620 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1457/2897] 10.222.0.67 () {58 vars in 1121 bytes} [Fri May 27 09:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:50.793246 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:50.815288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e30a-872a-4568-9a3c-ca8022838f97 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:50.815288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911c05d-ba1b-426b-88ae-8ef2d5e04c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:50.815288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c05d-ba1b-426b-88ae-8ef2d5e04c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:50.815288 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c05d-ba1b-426b-88ae-8ef2d5e04c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:50.815683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911c05d-ba1b-426b-88ae-8ef2d5e04c33 admin admin] PATH_INFO: `/v3/projects/a28a81101e044162940290f549349f4d/users/5c002f1227ca4d16986ce876f85e2e84/roles/249bc5a9054543f2afcf80e8e211bc3c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:50.815683 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c05d-ba1b-426b-88ae-8ef2d5e04c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28a81101e044162940290f549349f4d, user_id=5c002f1227ca4d16986ce876f85e2e84, role_id=249bc5a9054543f2afcf80e8e211bc3c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:50.817518 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911c05d-ba1b-426b-88ae-8ef2d5e04c33 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:50.832461 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1441/2898] 10.222.0.67 () {60 vars in 1482 bytes} [Fri May 27 09:49:50 2022] PUT /identity/v3/projects/a28a81101e044162940290f549349f4d/users/5c002f1227ca4d16986ce876f85e2e84/roles/249bc5a9054543f2afcf80e8e211bc3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:56.842054 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:56.845449 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:57.019865 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b15e9-f34b-4a8d-9520-50712d854fa9 admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.108685 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.109354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.109633 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.109916 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.111912 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:57.131368 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.133448 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.146523 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1458/2899] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:57.929183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8d73-9b4a-4b66-9cc7-6603a367fd07 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.929183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8d73-9b4a-4b66-9cc7-6603a367fd07 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.929929 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8d73-9b4a-4b66-9cc7-6603a367fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.960643 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3f0e8d73-9b4a-4b66-9cc7-6603a367fd07 None None] MFA Rules not processed for user `5c002f1227ca4d16986ce876f85e2e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:57.961892 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3f0e8d73-9b4a-4b66-9cc7-6603a367fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.055130 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1442/2900] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:49:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:58.071724 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.073254 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.115540 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=100 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:58.192431 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e965-a2da-4f38-a699-7ef52f7298df service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.200195 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.200974 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.201260 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.201535 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.280123 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.282354 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.293725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1459/2901] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:49:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:01.663206 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.663798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.663798 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.684279 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] MFA Rules not processed for user `b5a4d71e0ae443f887659a69b0fba447`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:01.685565 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:01.693366 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1443/2902] 10.222.0.67 () {58 vars in 957 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:08.287679 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=52 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:11.677779 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:28.839001 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:29.023976 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be30fa-87d2-41f2-898a-2f5aac8227f7 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:29.027533 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:29.028174 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:29.028490 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:29.028771 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:29.038168 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:29.039596 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:29.049046 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1460/2903] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:50:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:31.186051 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:31.200833 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65c2d-01f3-45e0-9cc4-b5add025ee7f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:31.206631 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:31.207286 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:31.207569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:31.207849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:31.209705 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:31.222877 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:31.224509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:31.239785 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1444/2904] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:50:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:39.044867 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=26 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:41.234871 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:25.405725 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:25.415146 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510bf9-7253-4db8-9b85-f21efa98ce97 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:25.418900 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:25.420418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:25.420418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:25.420418 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:25.422043 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:25.436105 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:25.437600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:25.451081 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1461/2905] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:52:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:52:33.649762 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:33.651388 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:33.663157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2d435-7ae0-48d9-ba54-de257f64d4bc service nova] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:33.666821 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:33.667466 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:33.667753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:33.668027 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:33.669955 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:33.684729 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:33.686167 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:33.698038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1445/2906] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:52:35.444460 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=6 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:39.779033 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:39.787861 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c4a3e-b5a1-47d0-82ef-70c6d2bb75c5 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:39.791537 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:39.792165 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:39.792492 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:39.792774 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:39.794549 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:39.804134 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:39.805600 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:39.814034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1462/2907] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:52:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:52:40.127038 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:40.135940 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8c48d-4e5c-42a3-962f-84d0e8bf647a service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:40.140157 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:40.143251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:40.143251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:40.143251 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:40.143615 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:40.153800 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:40.155307 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:40.164569 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1446/2908] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:52:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:52:40.253534 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:40.262726 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f756bc-d8cb-4b7d-a40c-b668f7ed8a69 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:40.266489 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:40.267138 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:40.267421 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:40.267696 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:40.269573 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:40.284706 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:40.286786 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:40.298753 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1463/2909] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:52:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:52:50.160340 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=12 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:50.293402 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=12 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:54.373677 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:53:54.382543 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04c69a-6a45-403c-8138-be7171f68fb5 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:53:54.386509 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f6fdb7d7074ddba6170f110c750489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:53:54.387143 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:53:54.387425 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:53:54.387703 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:53:54.389504 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:54.399194 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:53:54.400642 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:53:54.408621 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1447/2910] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:53:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:54:04.404998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:05.211440 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:05.212868 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:05.226374 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e06ade-14e6-4057-b457-99a55f313a18 service neutron] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:05.232003 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4d716fddeb41d1a697a0f23db35a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:05.232723 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:05.233034 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:05.233870 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:05.235342 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:05.248190 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:05.249874 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:05.261649 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1464/2911] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:54:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:54:11.542624 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:11.544093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:11.559170 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3781700-4a4c-483b-a95f-2eff1063787a service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:11.564617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:11.565277 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:11.565568 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:11.565849 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:11.567777 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:11.580557 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:11.582216 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:11.593802 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1448/2912] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:54:14.921717 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:14.937129 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7bfc-ab6e-447d-986f-1aed86d98800 service nova] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:14.942793 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:14.943437 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] REQUEST_METHOD: `GET` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:14.943936 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:14.944219 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:14.946065 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:14.958604 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:14.960209 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:14.970635 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1465/2913] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:54:15.056861 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:15.121093 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29039b-d330-4d04-816d-88c557309d16 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:15.125865 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:15.126745 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:15.127104 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:15.127309 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] PATH_INFO: `/v3/users/b5a4d71e0ae443f887659a69b0fba447` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:15.128527 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a4d71e0ae443f887659a69b0fba447)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:15.130444 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:15.304433 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a4d71e0ae443f887659a69b0fba447'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:15.386750 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a4d71e0ae443f887659a69b0fba447'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:15.387396 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a4d71e0ae443f887659a69b0fba447'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:15.400465 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a4d71e0ae443f887659a69b0fba447'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:15.401131 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a4d71e0ae443f887659a69b0fba447'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:15.413225 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1449/2914] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:54:15 2022] DELETE /identity/v3/users/b5a4d71e0ae443f887659a69b0fba447 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:54:15.935380 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:15.946579 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae1cba-5d77-4fcc-b1bb-d76baa892f88 service placement] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:16.001748 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:16.002612 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:16.002889 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:16.003159 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] PATH_INFO: `/v3/projects/6e547fa4865147df9c4074f38d310e32` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:16.004362 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e547fa4865147df9c4074f38d310e32)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:16.006373 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:16.141302 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e547fa4865147df9c4074f38d310e32', 'request_id': 'req-cbbc550b-01e5-49f9-8a84-6868e40c61eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.215114 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e547fa4865147df9c4074f38d310e32', 'request_id': 'req-cbbc550b-01e5-49f9-8a84-6868e40c61eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.221863 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e547fa4865147df9c4074f38d310e32', 'request_id': 'req-cbbc550b-01e5-49f9-8a84-6868e40c61eb'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.233024 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] The token cache is being invalidate because project 6e547fa4865147df9c4074f38d310e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:54:16.233395 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.233948 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.235465 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1466/2915] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:54:15 2022] DELETE /identity/v3/projects/6e547fa4865147df9c4074f38d310e32 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:54:16.239505 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:16.243137 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:16.254753 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cdb76-7df8-45bb-8736-45dc311e7dfe admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:16.311374 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:16.312256 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:16.312586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:16.312867 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] PATH_INFO: `/v3/users/5c002f1227ca4d16986ce876f85e2e84` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:16.314183 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c002f1227ca4d16986ce876f85e2e84)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:16.316161 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:16.321586 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:16.501655 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c002f1227ca4d16986ce876f85e2e84'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.579171 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c002f1227ca4d16986ce876f85e2e84'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.579788 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c002f1227ca4d16986ce876f85e2e84'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.592805 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c002f1227ca4d16986ce876f85e2e84'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.593468 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c002f1227ca4d16986ce876f85e2e84'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:16.606193 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1450/2916] 10.222.0.67 () {58 vars in 1223 bytes} [Fri May 27 09:54:16 2022] DELETE /identity/v3/users/5c002f1227ca4d16986ce876f85e2e84 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:54:16.844252 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Authenticating user token {{(pid=80386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:16.845773 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.fernet_utils [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:16.859013 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc550b-01e5-49f9-8a84-6868e40c61eb admin admin] Validating token access rules against request {{(pid=80386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:16.918561 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc703507b8b64f64800e473a23bfee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41e0cce5349a484a984be8bf5c634f8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:16.919545 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:16.919837 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:16.920117 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] PATH_INFO: `/v3/projects/a28a81101e044162940290f549349f4d` {{(pid=80386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:16.921324 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28a81101e044162940290f549349f4d)` {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:16.923336 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] RBAC: Authorization granted {{(pid=80386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:16.929763 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:17.077253 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28a81101e044162940290f549349f4d', 'request_id': 'req-da17e3b5-a07f-4842-9179-7e5cba4b3495'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:17.146902 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28a81101e044162940290f549349f4d', 'request_id': 'req-da17e3b5-a07f-4842-9179-7e5cba4b3495'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:17.154035 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28a81101e044162940290f549349f4d', 'request_id': 'req-da17e3b5-a07f-4842-9179-7e5cba4b3495'} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:17.164185 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] The token cache is being invalidate because project a28a81101e044162940290f549349f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:54:17.164509 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:17.165157 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG keystone.notifications [None req-da17e3b5-a07f-4842-9179-7e5cba4b3495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:54:17.166677 dv-cinder-825492-18-smb devstack@keystone.service[80386]: [pid: 80386|app: 0|req: 1467/2917] 10.222.0.67 () {58 vars in 1232 bytes} [Fri May 27 09:54:16 2022] DELETE /identity/v3/projects/a28a81101e044162940290f549349f4d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:54:26.601953 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:27.179231 dv-cinder-825492-18-smb devstack@keystone.service[80386]: DEBUG dbcounter [-] [80386] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:00.600617 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:55:00.602090 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:55:00.673998 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1dfbf-ccd9-46bd-85e0-3d45791f179e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:55:00.733308 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260ffef539f14b29b103ab0bfdeb0000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f54360f1a44c26bd0122ca4da82a23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:55:00.733970 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:55:00.734255 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:55:00.734561 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:55:00.736368 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:55:00.748073 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:55:00.750054 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96528b-5a2f-4100-a507-4efcea44ca49 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:55:00.760284 dv-cinder-825492-18-smb devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1451/2918] 10.222.0.67 () {60 vars in 1365 bytes} [Fri May 27 09:55:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:55:10.755640 dv-cinder-825492-18-smb devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=58 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}